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Abstract — Fundamental results concerning the dynamics of 
abelian group codes (behaviors) and their duals are developed. 
Duals of sequence spaces over locally compact abelian groups 
may be defined via Pontryagin duality; dual group codes are 
orthogonal subgroups of dual sequence spaces. The dual of a 
complete code or system is finite, and the dual of a Laurent code 
or system is (anti-)Laurent. If C and are dual codes, then the 
state spaces of C act as the character groups of the state spaces 
of C^. The controllability properties of C are the observability 
properties of C^. In particular, C is (strongly) controllable if and 
only if is (strongly) observable, and the controller memory 
of C is the observer memory of C^. The controller granules 
of C act as the character groups of the observer granules of 
C^. Examples of minimal observer-form encoder and syndrome- 
former constructions are given. Finally, every observer granule 
of C is an "end-around" controller granule of C. 

Index Terms — Group codes, group systems, linear systems, 
behavioral systems, duality, controUabiUty, observability. 



I. Introduction 

A GROUP CODE is a set of sequences that has a group 
property under a componentwise group operation [15], 
[29]. For example, if G is any group and is the direct 
product group whose elements are the bi-infinite sequences 
with components in G, then any subgroup C of is a group 
code. 

A group code may be regarded as the behavior of a 
behavioral group system, in the sense of Willems [46], [47], 
[48], [49]. It has been shown in [15], [28], [29] that many of 
the fundamental properties of linear codes and systems depend 
only on their group structure. Most importantly, a group code 
or system has naturally-defined minimal state spaces. 

In this paper we study dual group codes and systems. Our 
motivation is the importance of duality in the study of linear 
codes and systems. (For brevity, we will usually say "code" 
rather than "code or system/behavior") 

Our first problem is to define the dual of a group code C. 
For this purpose we use Pontryagin duality, a rather general 
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notion of duality that applies to abelian topological groups. 
A closed abelian group code C in a sequence space W may 
then be characterized as the set of all sequences in W that are 
orthogonal to all sequences in the dual code C^- i.e., C may 
be characterized by a set of constraints ("checks"). 

An immediate consequence of this definition is that the dual 
of a complete code, namely a closed subgroup of a complete 
sequence space such as G^, is a finite code, namely a code 
all of whose sequences are finite. On the other hand, the dual 
of a Laurent code is (anti-)Laurent. 

We derive fundamental duality relations between the dy- 
namics of C and the dynamics of C^. For example, the state 
spaces of C act as the character groups of the state spaces of 
C^, and the observability properties of C are the controllability 
properties of C^. (Here observability is defined as in [28] as 
a property of a code, not of a state space representation as in 
[47].) 

More precisely, we decompose the dynamics of a group 
code into observer granules, in a decomposition dual to the 
controller granule decomposition of [15]. 

Our original goal was to construct a minimal observer-form 
encoder and a minimal syndrome-former/state observer for C 
based on its observability structure. This is straightforward 
in many particular cases, but surprisingly difficult in general. 
Fagnani and Zampieri [10] have succeeded in providing such 
constructions for group codes over general finite nonabelian 
groups in a purely algebraic setting. Therefore we merely 
present some general principles and examples of minimal 
observer-form encoder and syndrome-former/state observer 
constructions. 

Finally, we show algebraically that every observer granule is 
isomorphic to an "end-around" controller granule. As corollar- 
ies, we obtain purely algebraic proofs of many of our results. 

We should say that our restriction to abelian groups does 
not appear to us to be essential, except to allow the use 
of Pontryagin duality. More general notions of duality of 
nonabelian groups exist (see, e.g., [3]), but are beyond us. 
Most of the results of this paper do not appear to depend on 
the abelian property. (We show that C has abelian dynamics 
if and only if C is normal in its output sequence space; 
however, normality appears to us to be no more fundamental 
than abelianness.) It is striking that the syndrome-former 
construction of [10], like the minimal encoder construction 
of [15], applies to codes over (finite) nonabelian groups and 
makes no use of duality, although it employs the observability 
structure that we develop here. 
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Section 2 briefly introduces Pontryagin duality. Section 3 
discusses dual sequence spaces of several important types, 
namely complete, finite and Laurent. Section 4 discusses dual 
group codes, proves that projections and subcodes are duals, 
gives dual definitions of wide-sense controllability and ob- 
servability, and presents some examples of dual group codes. 
Section 5 develops various results about dual state spaces. 
Section 6 is concerned with dual notions of finite memory, 
including strong controllability and observability. Section 7 
develops observability decompositions into granules dual to 
the controllability decompositions of [15], [29]. Section 8 
gives examples of the construction of minimal observer-form 
encoders, state observers and syndrome-formers. Section 9 
presents the end-around theorem and some corollaries. Section 
10 is a brief conclusion. 

II. Pontryagin duality 

Our treatment is based on Pontryagin duality, which ap- 
plies to topological groups. Pontryagin's original treatise [35J 
remains an excellent reference. For a more modem exposition, 
see any book on Fourier (harmonic) analysis on groups; e.g., 
Rudin [39] or Hewitt and Ross [20] . 

A topological group is a group that is also a topological 
space, such that the group and topological properties are con- 
sistent. We do not expect the reader to have much background 
in topology. We are not much interested in the topology 
of individual symbol alphabets; we usually think of them 
as being finite or at least discrete and/or compact, although 
we make more general statements when they appear to be 
warranted. However, topology does turn out to be important 
when considering codes whose sequences are defined on 
infinite index sets, even with finite symbol groups. For an 
introduction to topology, see, e.g., [25] or [40]. 

All topological groups in this paper will be assumed to 
be metric spaces; i.e., to have a topology induced by a 
distance function. Group homomorphisms will be assumed to 
be continuous, and group isomorphisms will be assumed also 
to be homeomorphisms. A subgroup of a topological group is 
itself a topological group under the induced subspace topology, 
but is considered to be a topological subgroup only if it is 
closed. 

In this section we review the two basic dualities of Pon- 
tryagin duality theory: character group duality and orthogonal 
subgroup duality. Sequence space duality is defined in terms of 
the former, and code/system duality in terms of the latter. We 
also introduce some additional fundamental duality principles: 
direct product/direct sum duality, sum/intersection duality, 
quotient group duality, and adjoint duality. 

A. Character group duality 

A character of a (topological) group G is a (continuous) 
homomorphism 

h:G M/Z 

from G into the additive circle group ("1-torus") R/Z (or 
equivalently into the complex unit circle under multiplication, 
to which M/Z is isomorphic). 



The character group of G, denoted by G~, is the set of all 
characters of G, with group operation defined by 

{hi o h2){g) = hi{g) + h2{g). 

Obviously hi o h2 = h2 o hi, so is abelian, and we may 
use additive notation; i.e., the sum of two characters hi, h2 is 
hi + h2. The identity of G' is the zero (or principal) character 
0, defined by 0(g) = for all g 6 G. The inverse of h E G' is 
the character —h defined by {—h){g) = —h{g). The characters 
of a group G are by definition unique, in the sense that no two 
characters hi, /12 have equal values hi{g), h2{g) for all g G G. 

When G is locally compact abehan (LCA), the fundamental 
Pontryagin duality theorem holds: 

Theorem 2.1 (Pontryagin duality): Given an LCA group G, 

(a) its character group G" is LCA; 

(b) the character group of G' is naturally isomorphic to G: 

G" ^ G. 

The natural isomorphism of this theorem associates g € G 
with the character (f)g e G" defined by (j)g{h) = h{g) for all 
h S G'. The theorem says that the character group of G" is 
precisely the set of all such characters: G'" = {(j)g : g € G}. 
In this sense, we may say that G acts as the character group 
of G", and write G'" = G and g{h) = h{g). 

Characters thus define a generahzed inner product, caUed a 
pairing, from G^ x G into R/Z, which we write as follows: 

{h,g) = h{g)=g{h). 

A pairing satisfies the "bihomomorphic" relationships 

(0,.g) = (/i,0) = 0; 
{hi + h2,g) = {hi,g) + {h2,g); 
{h,gi+g2) = {h,gi) + {h,g2). 

We say that h G G" and 5 e G are orthogonal if {h, g) = 0. 
The character table of G (or of G') is the "matrix" 

{G%G) = {{h,g)\hGG^,gGG}. 

The "rows" and "colunms" of this matrix are the "vectors" 

{h,G) = {{h,g)\geG}; 
{G%g) = {{h,g)\heG^}, 

which explicitly specify the characters h:G ^ M/Z e G" and 
g'.G" K/Z E G, respectively. The rows are distinct and 
form a group under row addition that is naturally isomorphic 
to G'; similarly, the columns are distinct and form a group 
that is naturally isomorphic to G. 

The elementary LCA groups in Pontryagin duality theory 
are the real numbers M, the integers Z, the circle group M/Z, 
and the finite cyclic groups Z^ = Z/mZ, which may be 
identified with the finite subgroups (m~^Z)/Z of M/Z. The 
foUowing table gives the corresponding character groups and 
pairings: 



G 


G' 


{Kg) 


M 


R 


hg mod Z (in M/Z) 


Z 


M/Z 


hg (in M/Z) 






hg (in Z^) 
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Note that in the cases of R and Z^, the character group G" is 
isomorphic to G; however, in these cases we caution that the 
isomorphism is not a "natural" one. Moreover, the case of Z 
and K/Z shows that G and G' need not even have the same 
cardinality. 

The fact that Z" = R/Z illustrates an important general 
result: the character group of a discrete group is compact and 
vice versa [39]. Since a finite group with the discrete topology 
is both discrete and compact, the character group of a finite 
group is finite; e.g., (Z„)' ^ Z^. 

B. Finite direct product duality 

Let I denote a discrete index set, which throughout this 
section will be finite. We will often think of I as an ordered 
time axis, such as a finite subinterval of Z. A set indexed by 
I such as w = {wk € Gk,k € 1} will correspondingly be 
called a sequence. 

Given a finite set of LCA symbol groups {Gk.k G X} 
indexed by I, their direct product is defined as the Cartesian 
product set of all sequences w = {wk £ Gk,k G I}, denoted 
by 

W=l[Gk. 

kei 

The group operation of W is defined componentwise, using 
the symbol group operations. If all Gk are equal to a common 
group G, then we write W = G-^. If \I\ = n, then we may 
alternatively write W = G". 

The finite direct product W is equipped with the natural 
product topology [39]. If all Gk are compact (resp. locally 
compact), then the finite direct product W = Hfe^fe is 
compact (resp. locally compact) [39]. If all Gk are discrete 
(resp. finite), then W is discrete (resp. finite). 

As expected, the character group of a finite direct product 
group is the direct product of the symbol character groups: 

Theorem 2.2 (Finite direct product duality): The character 
group of a finite direct product W = Hfeei of LCA groups 
is the finite direct product 

W =Y[ Gk', 

feel 

with pairing {h, g) defined by the componentwise sum 

{h,g) = ^{hk,9k), heW,geW. 

feex 

Note that X]feei(^fej .9fe) ^^^^ defined since T is finite. 

It follows that the character group of G = R" is G' = R", 
and that the pairing {h, g) between vectors 5 G R", /i e R" is 
the ordinary inner (dot) product h ■ g, mod Z. 

Similarly, since every finite abelian group may be decom- 
posed into a finite direct product of finite cycUc groups, it 
follows that every finite abelian group G is isomorphic to its 
character group G~. Moreover, if m is the exponent of G (the 
least integer such that mg = for all g( G G), then G may 
be written as a subgroup of (Zm)" for some n. The character 
group of (Zto)" may be identified with (Z^)", and pairings 
may then be defined in the usual manner as iimer products 
over the ring Z^. 



C. Orthogonal subgroup duality 

We now consider a second kind of duality, which will be 
the basis of our definition of dual codes and systems. 

Let G be an LCA group with character group G', and let 
5 be a subset of G. The orthogonal subgroup to S* C G 
(the annihilator of S) is the set of all elements of G' that are 
orthogonal to all elements of S: 

= {a&G^\ {a, s) = for all s G S}. 

The orthogonal subgroup to G itself is G^ = {0}, since the 
zero character is the unique character in G' that is orthogonal 
to all of G. Similarly, {0}-^ = G'. 

In topological groups, the group generated by a subset 
S' C G is defined as the smallest closed subgroup of G that 
contains S, called the closure S"^' of S. S is closed if S* = S"^'. 
Thus in topological groups the notion of closure involves both 
algebraic and topological closure. 

Orthogonal subgroups and closed subgroups are intimately 
linked by the following duaUty theorem [34]: 

Theorem 2.3 (Orthogonal subgroup duality): If G is an 
LCA group, and 5* is a subset of G, then 

(a) the orthogonal subgroup S-^ to 5 is a closed subgroup 
of G'; 

(b) the orthogonal subgroup S-^-^ to S-^ is the closure 5"^' 
of S in G. 

It follows that S* is a closed subgroup of G if and only if 
S^^ = S. Also, S-L-L-L = S^. 

We shall say that two orthogonal closed subgroups H C G 
and H-^ C G" are dual subgroups. We caution the reader that 
when we say that a group H-^ is the orthogonal group to H, 
we do not imply that H is closed, so that H-^-^ = H. However, 
if we say that two groups are dual or orthogonal groups, then 
we imply mutual orthogonality, and thus that both groups are 
closed. 

This notion of duality is consistent with the usual definitions 
of duality in a variety of contexts: 

• If G = R" and iJ is a subspace of G as a vector space 
over R, then is the orthogonal subspace to H in 
G' = R". Proof: for g G G and a G G~ , the pairing 
(a, g) is the ordinary dot product a • g, mod Z. But a 
subspace _ff of G is scale-invariant; i.e., h <E H implies 
ah e H for all a G R. Now a • ah = mod Z for all 
a G R if and only if a • h = 0. Thus 

7?^ = {a G G' I a • h = for all h G H}, 

which is the usual definition of the orthogonal subspace 
to H. 

• If G = R" and _ff is a lattice in R" (a discrete subgroup 
of R"), then is the dual lattice in G^ = R". Proof: 
Since (a, g) = a • g mod Z, 

i/-^ = {a G G' I a • h = mod Z for all h G H}, 

which is the usual definition of the dual lattice to H. 

• If G = (Zm)" and H is a subgroup (a linear block code 
of length n over Z^), then is the dual linear block 
code in G' = (Z^)". Proof: Here the pairing (a, g) is 
the usual irmer product over the ring Z^. 



4 



ffiEE TRANSACTIONS ON INFORMATION THEORY, VOL. 50, NO. 11, NOVEMBER 2004 



It is important to distinguish character group duality from 
orthogonal subgroup duality. The character group is often 
called the "dual group" to G in the mathematical literature. 
However, these examples show that the terms "dual code" 
and "dual lattice" are to be understood in the orthogonal 
subgroup sense. We use both types of duality in this paper; 
for example, we use the term "dual sequence space" in the 
character group sense, whereas we use the terms "dual code" 
and "dual system" in the orthogonal subgroup sense. We 
caution the reader to keep this distinction in mind, and to 
refer to the notation if in doubt. 

D. Sum/intersection duality 

Let G be a topological group, and let {Sj C G,j € J7} be a 
collection of subsets of G indexed by an index set J', possibly 
infinite. For topological groups, the group generated by the 
collection, called the sum of the subsets {Sj} and denoted 
by X^jgj- Sj, is defined as the closure S^"^ of the set S of 
all finite sums T^j^j Sj, where Sj denotes an element of Sj. 
Thus the sum (the group generated by the Sj) is closed both 
algebraically and topologically. 

Let {Sj- C G', j e J} be the collection of orthogonal 
subgroups to the subsets {Sj,j G J'}. The intersection 
r\jej o^ this set of closed subgroups is a closed subgroup 
of G'. Moreover, by orthogonal subgroup duaUty, it is the 
orthogonal group to the sum '^j^j Sji 

Theorem 2.4 (Sum/intersection duality): 

jej jeJ jej jej 

Proof. Let S be the set of all finite sums Sj for all 

Sj G Sj. Then S-^ = f\j Sj-, since h G G' is orthogonal to 

S if and only if /i is in all orthogonal subgroups Sj-. But by 

definition Sj = S^^, and by orthogonal subgroup duality 

= s^^ = (n, sD^. □ 

This theorem applies particularly when the subsets Sj 
consist of single elements Sj G G, called generators. The 
orthogonal subgroup to Sj is then the set of elements a € G' 
that pass the test {a,Sj) = 0, called a check (or constraint). 
This theorem then says that the orthogonal subgroup to the 
subgroup generated by the generators Sj , j G J', is the set of 
a G G^ that satisfy all checks (a, Sj) = 0,j G J. 

E. Quotient group duality 

Let H and be dual (closed) subgroups in G and G'. 
Every character g in the character group G of G' is evidently 
a character of H^. However, since for a given h G H-^ 

{h,g) = {h,g')^{h,g-g')=0, 

two characters g,g' G G of H-^ are identical if and only 
if g — g' G H, the orthogonal subgroup to H^. Thus the 
characters of naturally correspond one-to-one to the cosets 
H+r of H in G, which form the quotient group G/H. Indeed, 
it is easy to verify that the correspondence {H^)" ^ G/H 
is an isomorphism. In this sense, the quotient group G/H 
acts as the character group of H^, with pairing defined by 
(/i, H + r) = {h, r), just as G acts as the character group of 



G'. Correspondingly, H-^ acts as the character group of G/H 
with the same pairing [451. 

Theorem 2.5 (Subgroup/quotient group duality): If H and 
H^ are dual closed subgroups in G and G", then G/H acts 
as the character group of H^ and vice versa: 

{H^y = G/H; {G/Hy = H^. 

For example, if if is a subspace of G = M", and H-^ is its 
orthogonal subspace, then this theorem implies that dim H^ = 
dim G — dim H. 

We note that each element of a group G with a subgroup H 
may be written uniquely as g ^ r + h, where r is a representa- 
tive of the coset H+g G G/H and h € H. There is thus a one- 
to-one correspondence between G and the Cartesian product 
H X G/H, which may be viewed as a decomposition of G into 
two components, H and G/H. However, the two components 
play different roles. In general, G/H is not a subgroup of G; 
moreover, G may have no subgroup isomorphic to G/H. For 
example, R has no subgroup isomorphic to R/Z. Note that 
although the character group G" may similarly be thought of 
as being composed of H' and {G/H)", the two components 
exhange roles: {G/H)" = H-^ is by definition a subgroup of 
G", whereas H" is the quotient G" /H^, which in general is 
not a subgroup of G' . 

This result may be straightforwardly extended to the quo- 
tients of a finite chain J C H C G of closed subgroups of G. 
Since h G H^ implies h G J^, the orthogonal subgroup 
chain runs in the reverse order: H-^ C J-"- C G". For 
g G H,h & J-"-, the value of the pairing {h, g) depends only 
on the cosets J + g, H^ + h of J and H^ in H and J-*-, 
respectively. Therefore H/ J and J-^/H-^ act as dual character 
groups, with pairing defined by {H-^ + h,J + g) = {h, g). In 
summary: 

Theorem 2.6 (Quotient group duality): If J C H C G, 
then the dual quotient group J-^/H^ to H/J acts as the 
character group of H/J: {H/J)" = J-^ /H-^. 

Quotient groups such as H/J and J^ /H^ will be called 
dual quotient groups. 

The dual diagrams below illustrate two chains of subgroups, 
with their quotients. The right chain is obtained by invert- 
ing the left chain, replacing subgroups by their orthogonal 
subgroups, and replacing quotient groups by their character 



groups. 








G 




{0}^ = G" 






G/H 


1 


G7 J-L = J" 


H 








1 


H/J 


1 


J^/H^ = {H/J) 


J 




H^ 




1 


J 


1 


H^ = {G/H)" 


{0} 




G^ = {0} 





The following dual diagrams illustrate the chain of elementary 

groups {0} C mZ C Z C R, whose quotients are mZ = 
Z, Z/mZ — Zm, and R/Z, and its dual chain 

{0} C Z^ = Z C (mZ)-L = m^^Z C R' M, 

whose quotients are congruent to Z = (R/Z)",Zto = (Zto)", 
and M/Z = (mZ)', respectively. Indeed, the dual chain is just 
the primal chain scaled by m~^. 
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R R' = M 

I M/Z I ]R/(m-iZ) ^K/Z 

Z (mZ)-L = m-^Z 

I Z/mZ = Z„ 1 (m-^Z)/Z^Z„ 

mZ Z^ = Z 

I mZ^Z I Z 

{0} {0} 



F. Adjoint duality 

Quotient group duality is a special case of a general duality 
principle for adjoint homomorphisms. 

Let </): G ^ [/ be a homomorphism of an LCA group G to 
another LCA group U. The adjoint homomorphism 

(j)*:U-^G- 

is the unique homomorphism such that {v, (f>{g)) = {(j)*{v),g) 
for all g € G,v G U", where G' and t/' are the character 
groups of G and U, respectively. Exphcitly, the adjoint char- 
acter (f)*{v) is the unique character in G' whose values are 
given by (j)*{v){g) = {v, (t>{g))- Evidently the adjoint of <p* is 
(/>; i.e., 4>** = 4>. 

For example, let be a closed subgroup of G, and let 
4>:G G/H be the natural map defined by = H + 
g. Since acts as the character group of G/H, with 
{v, H + g) = {v, g) for g G G,v G C G', the adjoint 
(f)*:H^ G" is the inclusion of H-'- into G". 

The fundamental adjoint duality theorem is as follows: 

Theorem 2.7 (Adjoint duality): Given adjoint homomor- 
phisms (j>:G U, (f)*:U" G', the kernel of (j) is the 
orthogonal subgroup in G~ to the image of 0*. 

Proof. We show that g G (im (f>*)'^ if and only if 5 G ker tp. 
Let g G ker0; i.e., (j){g) = 0. Then {(f)*{v),g) ^ {v,(f)ig)) = 
0; i.e., every g G keicj) is orthogonal to (j>*{v) G G~ for all 
V E U". Conversely, if g is not in ker^, then (j){g) ^ 0, so 
{(j)*{v),g) = {v, (t>{g)) ^ for some cj)*{v) G G", because G 
U is the unique character u G U = U"" such that (w, u) = 
for all u e U". □ 

Note that whereas the kernel of (p is necessarily closed, the 
image of 0* may not be closed; the orthogonal subgroup to 
ker (j) is therefore the closure of im 4)* . 

In our example, the kernel H of the natural map (p-.G^ 
G/H is indeed the orthogonal subgroup in G to the image 
H-^ of the inclusion (j)* : H^ G'. Also, the kernel of 0* 
is {0} C H^ and the image of is the trivially orthogonal 
subgroup G/H = {H^Y in [H^y. 

The decomposition of G into H and G/H is sometimes 
illustrated by the following short exact sequence: 

{0} ^ ^ G ^ G/H {0}, 

where the first two maps are inclusions and the second two 
are natural maps. ("Exact" means that the image of each map 
is the kernel of the next.) The adjoint short exact sequence 

{0} ^ {G/ny = H^^G^^H^ = Gyn^ {o}, 

illustrates the exchange of roles upon which we previously 
remarked. 



A subgroup chain such as {0} C J C H C G impUes a 
chain of inclusion maps, e.g., 

{0} ^ J ^ H ^ G. 

The adjoint chain runs in the opposite direction, 

G^^W^r^ {0}, 

and consists of a chain of natural maps with kernels H^ = 
{G/ny, J^/H^ = {H/jy, and G^J^ = J\ illustrating 
the same decomposition of G" as in the first dual diagram 
above. 

in. Dual sequence spaces 

A group code or system (behavior) C is a subgroup of 
a sequence space >V. In this section we define complete, 
Laurent and finite topological sequence spaces, and determine 
their character groups (dual sequence spaces) W". We briefly 
discuss more general memoryless sequence spaces. 

A. Complete and finite sequence spaces 

We now let the discrete index I be possibly countably 
infinite: e.g., T = Z. In general, T need not be ordered; for 
example, we could consider an n-dimensional index set such 
as X = Z". However, for simpUcity we will assume X C Z 
from now on. We will continue to caU a set indexed by X a 
sequence. 

Given a set of LCA symbol groups {Gfe, k G T} indexed 
by X, their direct product is again defined as the Cartesian 
product set of all sequences w = {wk G Gk,k G X}, now 
denoted by 

W' = Y[ Gk. 

feel 

We caU a direct product a complete sequence space. Its 
group operation is still defined componentwise. We continue 
to write = G^ if all symbol groups are equal to G. 

The complete sequence space is equipped with the 
natural product topology [39]. If all symbol groups Gk are 
compact, then under the product topology W"^ is compact. 
However, even when all symbol groups are locally compact, 
need not be locaUy compact [39]. 

In topology, "completeness" is a property of metric spaces 
(every Cauchy sequence converges). A metric space is a 
topological space whose topology is induced by a distance 
function d{-,-) that satisfies the distance axioms: strict posi- 
tivity, symmetry, and the triangle inequality. 

For example, if X C Z and all Gfe are discrete, then the 
product topology is induced by the distance metric 

d(w,w') = 2-'(^'^'), 

where l{w,w') is the least absolute value |fc| of an index 
k gI such that Wk ¥^ w'^,. In other words, two sequences are 
regarded as "close" if they agree over a large central interval. 
In this case the product topology is also called the topology 
of pointwise convergence, because a series {w",n G N} 
converges to w if and only if, for aU € X, = Wk for all 
sufficiently large n. 
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In general, a topological direct product = fli Gk is 
complete if and only if aU are complete [40, II.3.5]. We 
will therefore assume from now on that all symbol groups 
Gk are complete metric spaces. Moreover, a countable direct 
product W of complete metric spaces is metrizable (can be 
endowed with a metric under which it is a metric space) [40, 
II.3.8]. 

In a complete metric space, a subspace is complete if and 
only if it is closed [40, 11.3.2]. Since all sequence spaces we 
consider will be complete metric spaces, we will generally 
use the term "closed" rather than "complete" for subspaces. 
We will reserve the term "complete" to mean "closed in the 
product topology;" i.e., as a subspace of a complete sequence 
space W^. 

In behavioral system theory, a behavior C C is called 
"complete" if whenever a sequence w e W satisfies all finite 
C-checks, then w G C. As we will discuss in Section 4.6, this 
notion of completeness usually coincides with the topological 
definition, but may need to be generaUzed. 

On the other hand, the direct sum of the symbol groups 
{Gk,k G 1} is defined as the subset of comprising the 
sequences w = {wk} in which only finitely many symbol 
values Wk are nonzero (sometimes called the set of "Laurent 
polynomials" in system theory), denoted by 

feex 

We will call a direct sum Wf a finite sequence space. Sums 

are still defined componentwise, and W/ is evidently closed 
under finite sums. If all symbol groups are equal to a common 
group G, then we write W/ = {G^)f. 

The direct sum W/ is equipped with the natural sum 
topology [39]. If all Gk are discrete, then the sum topology 
is simply the discrete topology (the topology induced by the 
Hamming metric). Such a setting is purely algebraic, with 
no additional topological structure. If all symbol groups are 
complete, then W/ is topologically complete under the sum 
topology. 

If X is finite, then there is no distinction between a direct 
product W and the corresponding direct sum W/, either 
algebraically or topologically. However, if T is infinite, then 
Wf is a proper subset of W, and the sum topology of W/ is 
in general different from the topology of W/ as a subspace of 
W^. In particular, W/ is not closed in VV^, and its closure is 
iyVjY = W^, where the first superscript "c" denotes closure 
or completion in W. 

B. Direct product/direct sum duality 

Although an infinite direct product of LCA groups is not 
necessarily LCA, the following duality theorem nevertheless 
holds [22]: 

Theorem 3.1 (Direct product/direct sum duality): The 
character group of a direct product = O/cei ^fe LCA 
groups is the direct sum 

(wy = ^Gk, 

feel 



with pairing {h, g) defined by the componentwise sum 

{h,g) = ^{hk,gk) 
feex 

foih&{W)\g&W. 

Note that the sum J2k£xi^k, gk) is well defined, since only 
finitely many hk are nonzero. 

In other words, the dual of a complete sequence space is 
the finite sequence space with the dual symbol groups, and 
vice versa. 

C. Laurent sequence spaces 

In convolutional coding theory and classical linear sys- 
tem theory, aU sequences are usually semi-infinite Laurent 
sequences — i.e., sequences that have only finitely many 
nonzero symbol values before some arbitrary time, say fc = 0, 
or equivalently that have a definite "starting time." 

A natural definition of a Laurent sequence space is the 
direct product of a finite sequence space defined on the "past," 
I~ = {k €l\ fc<0} and a complete sequence space defined 
on the "future," J+ = {A: G J | A: > 0}: 

Vfeex- / \feex+ / 

We call Wl the Laurent product of the symbol groups 

{Gfe,fcel}. 

Similarly, we define an anti-Laurent sequence space by the 
anti-Laurent product 

wz=f n G^y^l^cX 

Vfeex- / \feex+ / 

By direct product/direct sum duality, it is immediate that the 
dual of a Laurent sequence space is an anti-Laurent sequence 
space: 

Theorem 3.2 (Laurent/anti-Laurent duality): . The anti- 
Laurent sequence space Xi ^ ijlkei- '^k) ^ (0feex+ ^k) 
acts as the character group of the Laurent sequence space 
= (©frex- G'fe) (rifeex+Gfe), and vice versa: 
{WlY - A-^. 

Note that in this case, for x G X^^-w G Wl, the pairing 
(x, w) = J2keTi^k,Wk) is well defined, because only finitely 
many pairings {xk,Wk) are nonzero. 

It is customary to reverse the direction of time in the dual 
sequence space A^, so that it also becomes a Laurent sequence 
space. This yields a nice symmetry between the primal and 
dual spaces, which is lacking for the complete/finite pair. 

D. Memorylessness 

Memorylessness is a set-theoretic property of a subset V 
of a Cartesian product sequence space = Hfeex^fc- 
subset V will be called memoryless if for any partition of the 
index set I into two disjoint subsets J and I — J, if V\j and 
V\x-j are the corresponding restrictions of V (see Section 
4.3), then V is the Cartesian product 

V = V\jX V\x_j. 



FORNEY AND TROTT: DUALS OF ABELIAN GROUP CODES AND SYSTEMS 



7 



In general, V will be called a sequence space if and only if 
V is memoryless. It is easily verified that complete, finite and 
Laurent sequence spaces are memoryless. 

Another example of a memoryless sequence space is the 
set I2 of all square-summable sequences in a real or complex 
complete sequence space W^. The character group of I2 is the 
dual square-summable sequence space ^2- More generally, for 
1 < p < 00, the set Ip of all p-power-summable sequences 
is memoryless, and its character group is {Ip)" = Iq, where 
i + i = 1 [39]. 

Given a set of symbol groups {Gfc, k £ Z}, the direct prod- 
uct = rifcGi clearly the largest possible sequence 
space with these symbol groups, since it consists of all possible 
sequences w such that Wk G Gk for all k E 2. Conversely, 
the direct sum Wj = ^^^gj Gk is the smallest memoryless 
sequence space V such that V|;; = Gk for all fc e Z, since by 
memorylessness the finite sequence (Jlje j- ^ ^\i-J must 
be in V for any finite J' C Z. It follows that if X is finite, then 
yV"^ — Wf is the only possible memoryless sequence space 
with symbol groups {Gk}- 

IV. Dual group codes 

A group code, system or behavior is a subgroup C of a 
sequence space W. In the topological group setting, it is 
natural to define a topological group code or system to be 
a closed subgroup of a topological sequence space. Therefore, 
unless stated otherwise, the term group code will hereafter 
mean a closed subgroup C of a complete, finite or Laurent 
sequence space W. 

In this section we establish the basic duality between a 
closed group code C and its dual code C-^. This shows that 
the dual code of a complete code is a finite code, and vice 
versa. We show that if C has certain symmetries such as 
linearity or time-invariance, then so does C^. We prove a basic 
projection/subcode duality theorem. A more general principle 
is conditioned subcode duality, which can be regarded as 
a fundamental behavioral control theorem. We discuss the 
meaning of completeness in both a topological and behavioral 
sense, and agree to define completeness here as closure in a 
complete sequence space (i.e., closed in the product topology). 
Completeness is then dual to finiteness. We briefly discuss 
Laurent completion and "Laurentization." Finally, we define 
dual notions of controllability and observability, based on the 
notions of completion and finitization. Several example codes 
are given to illustrate these concepts. 

A. Group code duality 

We define the dual code to a group code C C W as the 
orthogonal subgroup to C in the dual sequence space W". By 
orthogonal subgroup duality, we have immediately: 

Theorem 4.1 (Group code duality): If C C W is a (closed) 
group code, then its dual is a (closed) group code in W, 
and C^^ = C. 

Thus, given W, a group code C is completely characterized 
by its dual code C^, and vice versa. Moreover, the dual code 
of a complete code is a finite code, and vice versa. 



If all symbol groups Gk are discrete, then the finite sequence 
space Wf = 0j Gk is discrete, so every subgroup C of Wf is 
closed. In other words, this discrete setting is purely algebraic 
and topology may be ignored, even when I is infinite. 

The dual sequence space of W/ = is the complete 

sequence space (IV/)" = Hi ^fc ■ Gk is discrete, then 

each Gfc" is compact and (W/)~ is compact. By the orthogonal 
subgroup duality theorem, the closed subgroups of (W/)" are 
precisely those subgroups that are duals of group codes in Wf. 

Thus whereas all subgroups of W/ are closed, only certain 
subgroups of (WfY are closed. This asymmetry should not 
be surprising, since even if Gk" = Gk, the complete sequence 
space (Wf)" is much larger than the finite sequence space 
Wf, and by Theorem l4. ll there is a one-to-one correspondence 
between codes in (Wf)" and codes in Wf. 

Behavioral system theory has traditionally restricted itself 
to complete behaviors.' But we observe that the dual of 
a complete group behavior C C W^ is a finite behavior 
G (yV^y. Thus any theory that encompasses both com- 
plete behaviors and their duals must encompass non-complete 
behaviors, particularly finite behaviors. 

B. Linearity and time-invariance 

In this subsection we briefly discuss the important properties 
of linearity and time-invariance. As in [15], linearity and time- 
invariance play no essential role in our development, although 
we often use linear and/or time-invariant codes as examples. 
Within our group-theoretic framework, linearity and time- 
invariance are simply additional symmetries of a group code, 
which are reflected by dual symmetries in the dual group code. 

A group code C C (R")-^ over the real field R is linear if it 
is invariant under all isomorphisms a: (R")-^ — > (R")-^ defined 
by scalar multiplication by a nonzero scalar a ^ G R. Since 
(x, aw) = (ax, w), the dual of a linear code C is linear. 

Similarly, a group code C C >V is time-invariant (or shift- 
invariant) if the time axis is X = Z, if all symbol groups are 
the same, and if C is invariant under the delay isomorphism 
D:W ^ W defined by D(\v)\k = Wfe-i; is., if DC = C. 
Since {yi,D(w)) = (L»"^(x),w), the dual of a time- 
invariant group code C satisfies D^^C^ = and is thus 
time-invariant. 

If C C (R")^ is both linear and time-invariant, then 
(x, w) = (x * w)o, where x is the time-reverse of x and 
denotes convolution. More generally, (x, _D'^(w)) = (x*w)fe. 
It follows that X is in if and only if the convolution x * w 
is the zero sequence for all w G C. This shows that pairings 
of linear time-invariant code sequences may be evaluated by 
sequence convolutions, and further motivates inverting the 
direction of time in the dual sequence space W". 

C. Restrictions, projections and subcodes 

In [15], we asserted that projections and subcodes of a 
group code C play dual roles. This will turn out to be our 
key dynamical principle. 

'indeed, Willems [46, p. 567] has asserted, no doubt whimsically, that "the 
study of non-complete systems does not fall within the competence of system 
theorists and could be better left to cosmologists or theologians " 
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Let W be a sequence space defined on an index set T, let 
i7 C I be a subset of J, and let J — »7 be the complementary 
subset. 

The restriction Rj-.Y^ W\j defined by Rj{w) = 
^|>7 — {wk,k € i/} is a continuous homomorphism. Since 
W is memoryless, W = W\j x W|i_j-, the image of the 
homomorphism is and its kernel is {Ojij- x W|x-j-- 

The topology of yV\j is induced from that of W. 

The projection Pj:W — > W is an essentially identical 
map defined by Pj{w) = (w|^, 0^x_j), a continuous homo- 
morphism with the same kernel whose image is Pj{}V) = 
W\j X {0}|i_j. 

Let C be a closed subgroup of W. Then the kernel of either 
the restriction Rj:C y^\j or the projection Pj: C — > W is 
the subcode C-i-j = C n ({0}|j- x >V|i_j-), namely the set 
of all code sequences w e C such that Wk =Q when k € J. 
As the kernel of a continuous homomorphism of C, a subcode 
C-x-j is a closed subgroup of C. 

Similarly, the restriction C[.i_j- = {C;x-j)[i-j of the 
subcode C-x-j to I — J, which is isomorphic to C-x-j, is a 
closed subgroup of the restricted code C\x-j = Rx-j{C). 

By the fundamental homomorphism theorem, the image C^j 
of Rj:C ^ Wu (or the image Cu x {0}\x-j of Pj:C ^ 
W) is algebraically isomorphic to the quotient group C/C:i_j-. 

However, we caution that in certain atypical cases the 
topology of the restriction C|j- as a subspace of W\j is not 
necessarily consistent with the topology of the quotient group 
C/C:x-j- In particular, even though CjC-x-j is necessarily 
closed, C\j may not be closed in W| j-. 

Example 1. Let W = M^, and let C be an irrational lattice in 
W-\ e.g., the lattice 

C = {{am + bn, —bm + an) \ (to, n) G Z^}, 

where the ratio a/6 is irrational. C is discrete, and thus a closed 
subgroup of K^. The restriction C\j of C to either coordinate is 
C\j = {am + bn \ (m, n) G Z^}. The kernel of the restriction 
is C;x-j = {0}, since am + bn = imphes m = n = when 
a/b is irrational. Thus C/C-x-j is discrete and homeomorphic 

to Z2. 

On the other hand, as a subspace of W|j^ = M, the 
restriction C\j is not closed, but rather is a dense subgroup of 
R whose closure is {C\jY^ = M. Thus these two topologies 
are inconsistent. 

Notice that, by orthogonal subgroup duality, = {0} 

and (C|j-)^^ = M. Therefore projection/subcode duality (see 
next subsection) holds in the form C\.j = {C\j)-^, even though 
iC\:j)^ ^ C\j (rather, (C,:^)^ = [C^jY'). □ 

It can be shown that a restriction C^j is closed in W^j 
if the sequence space W is discrete (because all subgroups 
are closed in the discrete topology), or if W is compact (the 
dual to the discrete case; see Section 5.3), or if W = (R")-^ 
and C is a subspace (since subspaces of M" are closed in the 
EucUdean topology). As these are the cases of most interest in 
coding and system theory, the potential pathology illustrated 
by Example 1 may usually be ignored; i.e., restrictions and 
projections are usually closed subgroups of their respective 
sequence spaces. We discuss this point again in Section 5.3. 



D. Projection/subcode duality 

The results of this subsection follow from the simple 
observation that for w G W, x G W*, the pairing (x, w) may 
be decomposed as follows: 

{x,w) = (x|j^,W|^) + {xix-j,wix-j). 

Lemma 4.2 (Restricted sequence spaces): Let W be a se- 
quence space defined on an index set I, let W be its dual 
sequence space, and let J be any subset of I; then 

(i) (W|j-)' = (W')ij-; i.e., the character group of a restric- 
tion iW\jy is the corresponding restriction of W". 

(ii) W = W\jxW\x-j implies W = {W)\jx{W')\x-j; 
i.e., if W is memoryless, then W is memoryless. 

(iii) Pj{W)^ = Px-j{W); i.e., the orthogonal subgroup to 
the projection Pj{W) is the complementary projection 
of >V^ 

Our central result is then the following projection/subcode 
duahty theorem: 

Theorem 4.3 (Projection/subcode duality): Let C and C-^ 
be orthogonal closed group codes in sequence spaces W 
and W", respectively. Then the orthogonal subgroup to the 
restriction C\j is the restricted subcode {C-^)\:j- 

Proof. Since ((x| Oix-j-), w) = (x|j-,W|j-), we have the 
following logical chain: 

X|^±C|j ^ (x|^,0|x_j) ±C 
^ (x|j, 0|x_^) gC^ 
^ X|^G(C^)|.^. □ 

Note that if C\j is not closed, then the orthogonal subgroup 
to {C-^)\:j is the closure of C\j. 

In the language of coding theory, this theorem is stated as 
follows: the dual of a punctured code is the corresponding 
shortened code of the dual code. 

This result immediately implies various corollaries: 

Corollary 4.4 (Projection/subcode duality corollaries): 
Under the same conditions: 

(a) The orthogonal subgroup to the projection Pj{C) = 
C\j X {0}ix-j is {C^)i:j x {W^)ix-j. 

(b) The orthogonal subgroup to the restricted subcode C^. j 
is the closure of (C-^)^j in {W)\j. 

(c) The orthogonal subgroup to the subcode C:j is the 
closure of {C^)\j x {W')\x-j in W^ 

(d) If C\j is closed in W\j, then C\j and {C-^)\;j are dual 
group codes. 

(e) The orthogonal subgroup to the direct product C^j x 

C\x-J is {C^)\:J X {C^)\..X-J. 

E. Conditioned code duality 

The following generalization of projection/subcode duahty 
is the key lemma for the graph duality results of [14]. It is 
also a fundamental result for behavioral control theory.^ 

^We are grateful to H. Narayanan for pointing out that our conditioned code 
duality theorem is closely related to his "implicit duality theorem," which he 
has proved and used extensively in various settings [31], [32], [33]. 
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Figure 4.2. Dual conditioned code (C^ | T)^). 



Let C be a group code in a sequence space W defined on 
an index set I, and let 2? be a group code defined on W|i- j, 
where J (ZI. The conditioned code [C \ V) is then defined 
as the set of all c G C such that c^x-j G 'D: 

(C I P) = {c e C I c|i_j e P} = C n {W^ x v). 

Note that since C,W\j and V are closed, (C | P) is closed. 

The conditioned code may be interpreted in the behavioral 
control context of Figure 4.1. The symbols in W^j represent 
to-be-controlled variables, those in Wp-j represent control 
variables, and C represents a plant whose behavior constrains 
both. The symbols in W|i_j are further constrained by a 
controller V. The restricted conditioned code (C | T>)^j 
represents the controlled behavior of the variables in W| 

The generalized theorem is then as follows (see Figure 4.2): 

Theorem 4.5 (Conditioned code duality): If C and are 
dual group codes defined on I, and T) and are dual group 
codes defined on a subset I — J I, then the restricted 
conditioned codes (C | 'D)\j and (C^ | 'D^)\j are dual group 
codes defined on J, assuming both are closed. 
Proof. First observe that [C \ 'D)\j may alternatively be 
characterized as the restricted subcode 

{C\V)\j = {C + m\jy.V)\j, 

since c e (C | P) if and only if there is a d\i-j G V such 
that (c + (0| J-, d|i_j-))|x_ J- = Ojx_j-. Assuming that both 
[C I Ty)\j and (C^ | P^)|j are closed, we then have 

= (c^n({o}|^xP)^)i^ 
= (c^n((>v")|jxp^))i^ 

where we have used projection/subcode, sum/intersection, and 
direct product duality. □ 

Notice that (C | yV\x_j) = C, whereas (C | = 
C-j. Therefore projection/subcode duality, namely {C\j)^ = 
{C^)y j, is a special case of conditioned code duality. 

Moreover, as V ranges from {0}|i_j to W|i_j, the re- 
stricted conditioned code (C | T>)\j ranges from the restricted 
subcode C\.j to the restriction C\j. This is the essence of the 
"most beautiful behavioral control theorem" [42], 



F. Completeness revisited 

In behavioral system theory, the completion of a system C 
in a complete sequence space is defined as [47] 

C™™Pi {w e W|^ e C\j for all finite J C X}, 

and C is called complete if C'^°™p' — C. In other words, C is 
complete if any sequence w G that looks like a sequence 
in C through all finite windows is actually in C. 

The following result characterizes the closure C^' of a 
subgroup C G yV"^, which we also call its completion C^, in 
almost the same way: 

Theorem 4.6 (Completion): If C is a subgroup of a com- 
plete sequence space W"^ defined on an index set I, then the 
closure (completion) of C is 

= {w G W= I w\j G [C\jY^ for all finite J C I}. 

Proof. By orthogonal subgroup duality, is the dual of the 
dual code in the dual finite sequence space (>V^)~. Since 
C-^ is finite, it is certainly generated by its subcodes {C-^);j 
for all finite J: 

J7 finite 

By sum/intersection duality, — C^^ is the intersection of 
the dual codes {(C^):j)^: 

J' finite 

The theorem follows since by Corollary I4.4r c). 

= {w G w| J G (C|j)^i}. □ 

It follows that if the restriction C\j is closed for all finite 
J I, then completeness in the behavioral system theory 
sense is equivalent to closure in the product topology, which 
is what we call "completeness" in this paper In particular, the 
two concepts coincide if all symbol groups Gt are discrete. 

A reviewer has pointed out that Theorem 14.61 may be 
extended to the case in which C is merely a subset of W^. 

G. Completion/finitization duality 

The finite subset (or "finitization") of a subgroup C of a 
complete sequence space will be denoted byC/ = CnW/. 
We say that C is finite if C = C/. C is evidently a subgroup 
of W/. We will assume that C/ is closed when endowed with 
the topology of W/. For example, the finite subset of W or 
of Wl is W/. 

The following result shows that completion and finitization 
are duals: 

Theorem 4.7 (Completion/finitization duality): Let C be a 
closed subgroup of a complete, finite or Laurent sequence 
space W with symbol groups {G^, k G T}, and let C"*" be the 
dual subgroup in the dual sequence space W", with symbol 
groups {Gk }- Let C/ be the finite subset of C, and assume 
that Cf is closed when endowed with the topology of Wf. 
Then the dual subgroup to C/ in (WY — Ilfcei^fc" 
completion of C-^ in (>V")=: (C/)^ = [c^Y- 
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Proof. Following the proof of Theorem 14.61 C/ is generated 
by the finite subcodes C-j of C for all finite J: 

Cf- C:J. 
J finite 

By sum/intersection duality, (C/)^ is the intersection of the 
dual codes (C^j)^: 

J finite 

By projection/subcode duality, 

(C::,)^ = {wG(WT|w|je((C^)l^n, 

so 

(C/)^ = {w £ iyvy I W| J £ {{C^)\jY^ for all finite J}, 
which by Theorem l4!6l is (C^Y . □ 

H. Laurent codes 

Similarly, a Laurent group code is a closed subgroup C of 
a Laurent sequence space W^. The dual of a Laurent group 
code C is an (anti-)Laurent group code in the dual (anti-) 
Laurent sequence space (Wl)". 

As in Theorem 14.11 if C and are dual Laurent group 
codes, then either determines the other. Here the primal and 
dual codes are symmetric. 

The Laurent completion of a subgroup C of a Laurent 
sequence space Wl is the closure of the group generated by 
C in Wl, denoted by C^. C is a Laurent group code if and 
only if C = C^. For example, the Laurent completion of W/ 
is Wl. 

The Laurent subset ("Laurentization") of a subgroup C of 
a sequence space W will be denoted by C^; i.e., 

is endowed with the topology of Wl- C is Laurent if C = 
. For example, the Laurent subset of is Wl- 

L Wide-sense controllability and observability 

Fagnani [6] has proposed an elegant definition of (wide- 
sense) controllability, which we restate as follows. A complete 
group code C C is controllable if {CfY = C. In other 
words, a complete group code is controllable if it is generated 
by its finite sequences. Fagnani has shown that a complete 
compact time-invariant group code that is controllable in this 
sense is controllable in the sense of Willems [47]. 

More generally, we say that a group code C in a sequence 
space W is controllable if {CfY ~ C'^; i.e., if the completion 
of C in yV"^ is the completion of the finite sequences of C. The 
complete code {CfY will be called the controllable subcode of 
the complete code C^. Note that any finite code C is necessarily 
controllable. 

We then propose the following dual definition: a group code 
C in a sequence space W is observable if (C'^)/ = Cf. In 
other words, completing C does not introduce any new finite 
sequences beyond those already in C. The finite code {C^)f 



will be called the observable supercode of the finite code Cf. 

Note that any complete code is necessarily observable. 
The following shows that these two definitions are duals: 
Theorem 4.8 (Controllability/observability duality): If C 

and C-^ are dual group codes, then: 

(a) and (C^)/ are dual group codes; 

(b) The controllable subcode {CfY of C and the observable 
supercode {{C^Y)f of (^^)/ ^re dual group codes; 

(c) The quotient group {{C-^Y) f / {^^) f ^'^^s as the character 
group of C7(C/)'=; 

(d) C is controllable if and only if C^ is observable. 
Proof. Part (a) is Theorem l4.7l This also implies part (b), since 

{{CfY)^ = {{Cf)^)f = {{c^Y)f- 

Part (c) follows by quotient group duality. Part (d) is a 
corollary of part (c), since 

c^^iCfY ^ cy{CfY = {0} 

^ {{c^Y)f/{c^)f-{or-{o} 
4^ {{c^Y)f = {c^)f- □ 

Note that these notions of controllability and observability 
do not depend on I being ordered. Therefore they apply to 
systems with unordered time axes; e.g., two-D systems [36], 
[44], [11], [12]. 

The core meaning of "controllable" is that any code se- 
quence can be reached from any other code sequence in a finite 
interval. We will consider a strong notion of controllability 
below, and will prove that strong controllability implies con- 
trollability in the sense of this section when all symbol groups 
are compact. Similarly, the core meaning of "observable" is 
that observation of a code sequence during a finite interval 
gives a sufficient statistic for the future or the past. We will 
show below that strong observability in this sense implies 
observability in the sense of this section when all symbol 
groups are discrete. 

We say that a code is local if it is both controllable and 
observable. By Theorem 14. 81 the dual of a local group code is 
local. Local codes can be completed or finitized without loss of 
structure, so it does not matter much whether we consider the 
complete, finite or Laurent versions of such codes. Practical 
convolutional codes are always chosen to be local, so as to 
avoid the pathologies associated with uncontroUability (au- 
tonomous behavior) and unobservability ("catastrophicity"). 

To illustrate, we now give a standard example of an un- 
controllable (autonomous) group code C that is inherently 
complete and cannot be "finitized" or "Laurentized" without 
losing its dynamical structure. Its dual C^ is an unobservable 
(catastrophic) group code that is inherently finite and cannot 
be completed without losing its structure. 

Example 2. Let G be an LCA group, let be the complete 
sequence space G^, and let C C be the bi-infinite repetition 
code over G; i.e., 

C = {g= (...,5,5,5,...) I 5 £ G}. 

C is a complete time-invariant group code which is isomorphic 
to G. 
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The dual sequence space W to W is the finite sequence 
space ((G")^)/, where G' is the character group of G. The 
dual group code is the bi-infinite zero-sum code over G", 
namely the finite code defined by 

C^ = {he((G'f)/|^/ifc = 0}. 

fcez 

This follows since for g = {. . . , g, g, g, . . .) E C and h G W, 
the pairing (h, g) is 

(h,g) = ^(/ife,5) = iY^ hk,g), 

which is equal to for all g e G if and only if J^k = 0, the 
sum being well-defined because there are only finitely many 
nonzero components in h G W". is a closed subgroup 
of the finite sequence space W", since it is the orthogonal 
subgroup to the complete code C. Like C, it is time-invariant. 

The repetition code C is uncontrollable, since its finite 
subcode consists of only the all-zero sequence, Cf = {0}, 
and this trivial subcode is complete. The zero-sum code C-*" is 
unobservable, since its completion is the complete sequence 
space (G")^.^ Thus finitization of C or completion of 
destroys dynamical structure. 

Clearly C/Cf = G, which by Theorem 14. Sf c) implies that 
W7C^ = G\ The cosets of in W are in fact the 
subsets of W" such that = h, for each h G G". C"*" 

is unobservable because no finite observation can distinguish 
between these cosets. □ 

J. Further examples 

We now give two more examples of dual group codes. 
The first involves a standard controllable and observable 
(local) time-invariant convolutional code over a finite symbol 
group and its dual. The second exhibits a curious complete 
time-invariant group code that can be finitized on the past 
("Laurentized") without loss of dynamical structure, but not 
on the future. Its dual has the dual property. These two codes 
were proposed in [27] and [28], respectively, but were not 
recognized there as duals. 

Example 3. Let C be the complete rate- 1/3 linear time- 
invariant convolutional code over Z4 comprising all linear 
combinations of time shifts of the generator 

g = (. . . , 000, 100, 010, 002, 000, . . .) 

C is closed in the complete sequence space ((Z4)^)^. 

The finite subcode C/ of C is generated by all finite linear 
combinations of time shifts of g, and is closed in the finite 
sequence space {{{'L/Cf^Y') f . The completion of Cf is C, so C 
is controllable. Thus C is local, since as a complete code it is 
automatically observable. 

Similarly, the Laurent subcode Cl is generated by all 
Laurent linear combinations of time shifts of g, and is closed 
in the Laurent sequence space (((Z4)"^)^)l. 

^ Proof: let c'™'"' be the sequence in C-^ with Cm = g,Cn = —g, and 
Cf; = for k m,n; then for fixed m the "limif of c^™'") as n ^ 00 in 
the product topology is the sequence with Cm = g and cj; = for k ^ m, a 
finite sequence that is not in . Since such unit sequences generate {G")^ , 
we have {C^Y = (G')^ ■ 



The dual code C is the finite rate-2/3 code linear time- 
invariant convolutional code over Z4 consisting of all finite 
linear combinations of time shifts of the two generators 

hi = (...,000,100,030,000,...); 
ha = (...,000,020,001,000,...), 

which are orthogonal to all time shifts of g under the usual 
inner product over Z4. (Equivalently, the convolutions hi * g 
and h2 * g of the time-reverses hi and ha are equal to 0.) 
C"*- is closed in the finite sequence space (((Z4)^)^)/. 

The dual complete code (C/)^ is the set of all linear 
combinations of time shifts of hi and ha. is the finite 
subcode of (Cf)-^, and (C/)-*" is the completion of C^. Thus 
is local. 

Here there is no essential difference between the finite, 
Laurent, or complete versions of C or C^. In general, the 
dynamical structure of a group code C is not affected by 
completion or finitization if and only if C is local. □ 

Example 4. The following is a much more exotic example (a 
"solenoid" [26]), and is a rich source of counterexamples. 

Loeliger [27], [1] proposed the following curious PSK-type 
code. Let C be the complete compact linear time-invariant code 
over the additive circle group R/Z that consists of all integer 
linear combinations of time shifts of the Laurent generator 

g = (. . . , 0, 2 7 4 I 8 7 • ■ •)■ 

Since 2g (mod Z) is a shift of g, the "input" at each time 
k is essentially a binary variable Uk G {0, which may be 
regarded as representing the subgroup (iZ)/Z of R/Z. The 
"output" symbol at time k is 

Uk Uk-l Uk-2 , Uk Ck-1 ^ TO /-^ 

Cfc = h • • ■ = G M/Z. 

2 4 8 2 2 ' 

Thus Cfc determines the entire past input sequence. 

If the output symbol is mapped onto the complex unit circle 
via Cfc t-* e^'^"^'", then C is a well-defined PSK-type code that 
transmits one bit per symbol and has a well-defined minimum 
squared distance (6.79. . . ). However, the symbol alphabet of 
C is the entire infinite circle group R/Z, rather than a finite 
subgroup as with ordinary PSK codes. Also, the code "state" 
Cfc_i lies in the infinite state space M/Z. Each state Cfc_i has 
two successors Cfc, but each Cfc has only one predecessor Cfc_i. 

The dual code to C is the finite discrete linear time- 
invariant code over the integers Z (the character group of M/Z) 
comprising all finite integer linear combinations of time shifts 
of the finite generator 

h= (...,0,1,-2,0,...). 

It is easily verified that h is orthogonal (mod Z) to all time 
shifts of g, that a sequence in (M/Z)^ is in C if and only if it 
is orthogonal to all shifts of h, and that a sequence in (Z^)/ 
is in C-*- if and only if it is orthogonal to all shifts of g. 

Loeliger's code C is uncontrollable, since its finite subcode 
consists only of the all-zero sequence, Cf = {0}. Indeed, its 
time-reverse C is a standard example of a chaotic dynamical 
system whose evolution depends entirely on initial conditions 
[2]. Nevertheless, C may be generated by a causal encoder 
with one input bit per unit time. 
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C has a natural Laurent subcode Cl that is generated by 
the input sequences that are Laurent. Thus while finitization 
destroys its structure, Laurentization does not. (However, 
Laurentization does reduce the symbol alphabet from the 
uncountably infinite set M./Z to the countably infinite set of 
dyadic numbers in M/Z.) On the other hand, the anti-Laurent 
subcode of C is {0}, since if the output is at any time, then 
it must have been at all previous times. Thus even though 
C is time-invariant, its time axis has a distinct directionality. 

The finite dual code is unobservable, since its comple- 
tion is the complete sequence space l/'. Its Laurent completion 
is (Z^)l (the dual of {0} C ((K/Z)^)^). However, its 
anti-Laurent completion is simply the set of all anti-Laurent 
integer combinations of shifts of h, which again indicates the 
directionality of the time axis. 

Interestingly, C-^ is a version of an example given in [28], 
[29] to show that the set of all sequences generated by a group 
trellis whose state space (in this case Z) does not satisfy the 
descending chain condition may not be a complete code. 

Pontryagin suggested as a general rule that a compact group 
might be best studied via its discrete character group [35]. In 
this spirit, we suggest that it might be useful in general to 
study compact solenoids via their discrete duals. In this case, 
for instance, the dual code is finite and has short integer- 
valued generators. □ 

V. Dynamical duality 

This section develops basic dynamical dual properties of 
dual group codes C and C^, such as: 

• The state spaces of act as the character groups of the 
state spaces of C. 

• The observability properties of are the controUabihty 
properties of C. 

A. Topological state space theorems 

The fundamental result of [15] is the state space theorem, 
which shows that for a group code C every two-way partition 
of the time axis induces a certain group-theoretic minimal 
state space S j. Moreover, there exists a minimal state re- 
alization for C in which every state space is isomorphic to the 
corresponding minimal state space Sj. We now discuss this 
theorem for the topological group codes of this paper 

Given a subset J <Z I, the subcodes C-j and Ca-j and 
their internal direct product C-j x Ca-j are closed normal 
subgroups of C. The (two-sided) state space of C induced 
by the two-way partition of I into {J,I — J} is then well 
defined as the quotient group 

^j{C) ^ . 

C: J X L:I-J 

The proof of the following version of the state space 
theorem goes through as in [15]: 

Theorem 5.1 (State space theorem): Given a group code C 
in a sequence space defined on an index set I and a two- 
way partition of I into "past" J and "future" X — J, the 
minimal state space of any state realization of C at the time 
corresponding to this "cut" is Sj-(C). 



In [15], one-sided state spaces PjiC) /C-j and 
Pt-j{C)/C;j are also introduced, and shown to be 
algebraically isomorphic to the state space Tjj{C). This 
follows from the correspondence theorem, since the kernels 
of the projections of C and of C;j x C-i-j onto J are the 
same, namely C-x-j- One-sided state spaces may also be 
defined using restrictions since, e.g., 

Pj{C) ^C\J 



c 



■■J 



As discussed in Subsection llV-CI a restriction C\j is home- 
omorphic to the quotient group C/C;j, provided that C\j is 
closed. With this caveat, we obtain a topological version of 
the one-sided state space theorem: 

Theorem 5.2 (One-sided state spaces): Under the same 
conditions, let C\j and C\j_j be the restrictions of C io J 
and I — J, respectively, and assume both are closed. Then 

C\j ^ C\i-j 



\:1-J 



Sj(C). 



Example 1 (cont.) Again, let C be a lattice {(am + 6n, —bm + 
an) I {m,n) G Z^}, where a/b is irrational. C is isomorphic 
and homeomorphic to Z'^. Letting J' and X — J denote the 
two single-coordinate subsets, we have C. j — C-x-j = {0}. 
Therefore Sj-(C) = C = I?, as expected, since either 
coordinate determines the lattice point and thus the other 
coordinate. 

In this case, if C^j and C|i_ j are endowed with the discrete 
topology, then they are homeomorphic to Z^, so Theorem 15. 21 
holds. However, as subspaces of R, C^j and C|i_j are not 
closed, and not homeomorphic to T^j{C). □ 

We will continue this discussion in Section 5.3. 



B. The dual state space theorem 

We can now relate the state spaces of a dual code to 
those of C, using the one-sided state space theorem. We must 
therefore continue to require restrictions to be closed. 

Theorem 5.3 (Dual state space theorem): If C and C"*" are 
dual group codes defined on X, then for any subset J ^X, the 
corresponding one-sided state space of acts as the character 
group of the corresponding one-sided state space of C: 



J 



Consequently the state space of is isomorphic to the 
character group of the state space of C: 

(i]j(c)r-Ej(c^). 



Proof. By quotient group and projection/subcode duality. 



□ 



In the usual cases, this simple but powerful theorem gen- 
eralizes a known result for linear codes over fields: the state 
spaces of dual codes have the same dimensions. In particular: 

. If Sj(C) is finite, then I]^(C) ^ Sj(C-L). 

• If Sj-(C) is a finite-dimensional real vector space, then 
dimSj(C) = dimSj(C^). 
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The following examples show that when the restrictions 
C\j and C\x-j ^re closed, the dual state space theorem 
gives a satisfactory system-theoretic result, even when C is 
uncontrollable, unobservable, or solenoidal. 

Example 2 (cont.) For the bi-infinite repetition code C over G, 
given any proper subset J" C Z, we have C:j = C-x-j = {0}, 
so the state space Sj-(C) is isomorphic to C = G. For the dual 
bi-infinite zero-sum code over G", {C-^)-j is the set of all 
finite sequences h with support in J' whose component sum 
0, YjkeJ^'' ~ whereas {C-^)\j is the set ((G')-^)/ of 
all finite sequences with support in J', so 



G^ 



where the cosets of {C-^)\:j in {C-^)\j correspond to the 
different possible component sums J2keJ ^ ^ ■ Hence 
S j-(C^) = (S jiC)y. The dual state spaces are isomorphic if 
and only if = 0". 

Note that has nontrivial state spaces, even though 
its completion is the memoryless sequence space W. The 
unobservability of is reflected in the fact that the state of a 
sequence h € cannot be observed from any finite segment 



of h. 



□ 



Example 3 (cont.) For any partition of the time axis into 
past k~ and future fc"*", the state spaces of both time-invariant 
codes C and C-^ of Example 3 are isomorphic to Z2 x Z4, 
which as a finite abelian group is isomorphic to its char- 
acter group. Generators for representatives of the cosets of 
C|.fc+ in C|fc+ are |010, 002, 000, . . .) and |002, 000, 000, . . .), 
which generate cyclic groups of orders 4 and 2, respectively. 
Generators for representatives of the cosets of {C^)\:k+ in 
{C^)\k+ are |030, 000, 000, . . .) and |001, 000, 000, . . .); the 
first has order 4, but the order of the second is only 2, since 



1002,000,000, . . .) is a code sequence in {C^)uk+. 



□ 



Example 4 (cont.) The state of Loeliger's code C at time 
k is the output Cfe e M/Z, since C,^- = {0} (if the future 
is all-zero, then Ck = 0, which implies that the past c^.- 
is all-zero). Since the dual code is the set of all finite 
integer combinations of h = (...,0,1, —2, 0, . . .), the state of 
at time k is essentially its most recent input Uk-i G Z 
(representatives of the cosets of {C^)\:k+ in (C^)|fe+ are 
generated by | — 2, 0, 0, . . .)). The dual state spaces are thus 
M/Z and Z, which are indeed each other's character groups, 
but which are not isomorphic. □ 

C. Non-closed restrictions 

However, in the exceptional cases where restrictions are not 
closed, the dual state space theorem can fail. 

Example 1 (cont.) As shown above, the irrational lattice 
C = {{am + bn, —hm + an) \ (m, n) G I?} is isomorphic 
and homeomorphic to 1?, and so is its state space Sj^(C) 
corresponding to splitting the two coordinates. The two re- 
strictions C\j and C\x-j are isomorphic and homeomorphic 
to 7? under the discrete topology, but not under the subspace 
topology. 



C = AI?, where A = 



The dual code is then 



The definition of the dual code C-^ depends on the sequence 
space in which C is considered to lie. If C is regarded as a 
subspace of M^, then the dual sequence space is M^, with 
pairing equal to the usual iimer product mod Z. Let us write 

a b 
-b a 

the irrational lattice = A~^l? in R^, whose state space 
is again isomorphic to I?. Thus, under the usual subspace 
topologies, the dual state space theorem fails. 

However, suppose we regard C as a subspace of the trimmed 
sequence space C\j x C\x-j under the discrete topology; 
then this sequence space is isomorphic and homeomorphic 



and the dual sequence space is isomorphic to 
As C is isomorphic to a repetition code 



to X 

(R/Z)2 ; 

over 7?, the dual code in this dual sequence space is 
isomorphic to a zero-sum code over (R/Z)^, whose state space 
is isomorphic to (R/Z)^ (see Example 2, above). Thus, under 
these topologies, the dual state space theorem holds. □ 

We conjecture that the dual state space theorem, and all later 
duality results, hold when the symbol groups Gk are taken as 
the restrictions C\{k}, with the appropriate topologies. 

However, as we see from this example, although use of 
nonstandard topologies may lead to results which are formally 
correct, they may not be consistent with the usual conventions, 
which are often based on subspace topologies. For instance, 
the usual definition of a dual lattice is with respect to R"; 
then the dual lattice of any full-rank lattice, even an irrational 
lattice, is itself a lattice (a discrete subgroup of M"), not some 
weird continuous compact group like (R/Z)^. 

One drawback of a Laurent sequence space is that in 
general it is neither discrete nor compact, so we may expect 
Laurent codes to provide further counterexamples, such as the 
following one. 

Example 5. Let C C (Z2)^ be the binary mirror-image code 
consisting of all binary sequences x e (Z2)^ that exhibit 
mirror symmetry; i.e., Xk = X-k for all k G Z. C is 
complete (a closed subgroup of the complete sequence space 
yV"^ = (2^2)^) and controllable (C is generated by its finite 
sequences, C = {Cff). Its dual code in W/ = ((^2)^)/ 
is the set of all finite binary sequences in C with xq = 0; i.e., 

= (C/):Z-{0}- 

may also be regarded as a Laurent code Cl in the 
Laurent sequence space Wl = ((^2)^)1., where it remains 
closed. Its dual (Cl)^ in this setting is an anti-Laurent code 
in yVi, which as a set is equal to the finite subcode C/. 

Whereas W/ is discrete and is compact, the sequence 
spaces Wl and are neither discrete nor compact. Thus 
whereas the restrictions of C C W"^ and C Wj to 
the past interval V = (— oo,0) are necessarily closed, the 
restrictions {Cl)\-p and {{Cl)'^)\'p are not necessarily closed. 
In fact, (Cl)|p is closed in Wl, but {{Cl)^)\v is not closed 
in Wl, even though they are identical as sets (both are equal 

to ((Z2)^)/). 

This shows again that the validity of our topological results 
depends very much on the topologies of the sequence spaces 
in which codes are regarded as being defined, and in particular 
on whether restrictions are necessarily closed. □ 
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C\j X C|i_j- 




j:;{o} 



Sj(C) 



X C\.,x-J 

Figure 5.1. Tableau illustrating state space and reciprocal state space theorems. 




In order not to have to continually deal with such patho- 
logical cases, we therefore impose from now on the following 
closed-projections assumption: 

The topology induced by every restriction or pro- 
jection onto a subset J7 C X is consistent with the 
topology of yV| In particular, projections of closed 
subgroups are closed in the subspace topology. 
A reviewer has pointed out that the closed-projections 
assumption is satisfied for a complete sequence space W if all 
symbol groups are compact metric spaces, and in particular 
if all Gfc are finite. Then W is a compact metrizable space, 
so every closed and thus compact subset of W has a compact 
and thus closed image under the continuous restriction map 

Under the closed-projections assumption, we can apply 
our duality results freely without continual consideration of 
topological issues. The reader must therefore use our results 
with caution whenever topological subtleties are suspected. 

D. The reciprocal state space theorem 

What is the character group of the two-sided state space 
Sj'(C)? The following theorem shows that it is the (two- 
sided) reciprocal state space of C-"-, defined as 

(C^)l^ X (C^)|x-^ 



(The reciprocal state space was introduced in a different 
context in [7].) 

Theorem 5.4 (Reciprocal state space theorem): If C and 
C"*" are dual group codes, then the reciprocal state space 
S'^(C-'-) acts as the character group of the two-sided state 
space Sj(C). 

Proof. Using quotient group, direct product, and projec- 
tion/subcode duahty, we have 

{C\,j X Cj-x-j-)""" 



C\:J X C\,j:-J 



{Cy,j)^ X (C|:x-^)^ 



,:7 X {C-)j-j 



□ 



The reciprocal state space theorem has an immediate corol- 
lary, which yields a fourth state space for the group codes that 
we are considering: 



Corollary 5.5: The reciprocal state space S'^(C) is isomor- 
phic to the state space T,j{C). 

Proof. By the reciprocal state space and dual state space 
theorems. 



□ 



We caution the reader that this result depends on the closed- 
projections assumption. Moreover, as we will discuss further 
below, it applies only when C is abelian. Nonetheless, it rounds 
out the state space theorem nicely when it apphes. 

When the reciprocal state space theorem holds, there is a 
chain 



Cy,j X Cy,x_j C C C X C| 



in which both quotients are isomorphic to T,j{C). The dual 
chain is 

which has quotients isomorphic to T,j{C-^) = Sj-(C) , as 
illustrated by the dual diagrams below. 



C\j X C|x-j- 



C\:J X C\,x-J 



(C^)l^ X (C^)|x-^ 



Figure 5.1 exhibits a related tableau of homomorphisms, in 
which all quotient groups are isomorphic to the state space 
Sj-(C). Note that every left-to-right or right- to-left chain of 
four maps in this tableau is a short exact sequence (a sequence 
in which the image of each map is the kernel of the next). 
Moreover, this tableau is self-dual, in the sense that the dual 
diagram is the corresponding tableau for C-^. 

E. The abelian dynamics theorem 

In this subsection we give a purely algebraic proof that the 
reciprocal state space S'^(C) is isomorphic to the state space 
Tij{C) when Sj-(C) is abelian. When T,j{C) is not abelian, 
S'^(C) is not well defined, but on the other hand the situation 
is not essentially different. Finally, we show that these results 
are a special case of the abelian dynamics theorem. 
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The one-sided state space theorem shows that we can 
compute the state <7j{c) G S j{C) of a code sequence c G C 
from either its "past" C|j or its "future" c^j_j; i.e., there 
exist homomorphic state maps a\j : C\j — > Y^jiC) and 
<J\z-j '■ C\x~j — > Sj-(C), whose images are the state space 
S j{C) and whose kernels are the restricted subcodes C\;j and 
Cyx-j, respectively. For c e C, the images of these maps must 
agree: (Jj{c\j) ^ cri-j{c\j_j). 

A general pair (w|j,W|i_j) e C\j x C\x-j is in C if 
and only if fJj{yv^j) = az-jiyf\x-j) [15]. Therefore we 
can test whether {yf\j,^\x-j) is in C by forming the state 
difference ("syndrome") 

d(w| J, W|i_ j) = crj(w| - cri- j(w|i_ j). 

Then (w|j',W|i_j) G C if and only if d.(yf\j ^^\x-J) = 0. 
In other words, C is the kernel of the state difference map 
d:C\j^C\x-j^^j(C). 

When Yjj(C) is abelian, the state difference map is a 
homomorphism. Since C is its kernel, it follows that C is a 
closed normal subgroup of C\j x C|x-j-, and therefore that 
the quotient group (C\j x C\x-j)/C {i.e., the reciprocal state 
space) is well defined. 

When S j{C) is not abelian, C is still the kernel of the state 
difference map. The following theorem shows that in this case 
C cannot be a normal subgroup of C| j- x C|i_j, and therefore 
the state difference map cannot be a homomorphism. 

Theorem 5.6 (algebraic reciprocal state space theorem): 
If C is an algebraic group code in the sense of [15], then the 
state space J^j{C) is abelian if and only if C is a normal 
subgroup of C| J- X C^x-j- 

Proof. On the one hand, if Sj(C) is abelian, then the state 
difference map d : C^jxC^x-j S j{C) is a homomorphism 
with kernel C, so C is a normal subgroup of C^j x C^x-j- 

On the other hand, if C is a normal subgroup of C^jxC^x-j, 
then the reciprocal state space S'^(C) = (C|j x C^x-j)/C is 
abelian, which implies that Y,j{C) = ^■^(C) is abelian. Let 
w G Pj{C); then w G C|j x {0}\x-j ^ C|j x C\x-j, so 
by normality wcw^^ G C and thus wcw^^c^^ G C for any 
c G C Now w has support J', so i-|x_ j-(wcw^^c^^) = 
0, which implies wcw^^c^^ G C;j and wcw^^c^^ = 
w Pj {c)w^^ {Pj{c))^^ . As w and Pj{c) run through 
Pj{C), the commutators \vPj{c)\f^'^{Pj{c)y^ G Cj 
therefore run through the generators of the commutator sub- 
group [Pj{C),Pj{C)]. Therefore [Pj{C),Pj{C)] C C.j. 
By a general property of commutator subgroups [38, Ex. 2.52], 
{C\j X C\x-j)/C is thus abelian. □ 

Theorem 15.61 shows that there is a distinct algebraic dif- 
ference between the abelian and nonabelian cases. However, 
the two cases are otherwise not fundamentally different. Even 
when C is not a normal subgroup of C\j x C|i_j, we can 
still partition C\j x C\x-j into "cosets" corresponding to the 
distinct possible state differences in Sj-(C) under the state 
difference map, thus establishing a one-to-one map between 
the "cosets" of C in C\j x C\x-j and the state space S j{C). 
Thus the basic idea of a correspondence between syndrome 
equivalence classes of C\j x C\x-j ™d Yij{C) still holds. 

There is a nice generalization of the above theorem, as 
follows. Given an algebraic group code C in the sense of 



[15], the label groups of C are defined as the quotient groups 
{C|{fc}/C|:{fc} = I]{fe}(C),A; G X}. The group code C then has 
the same dynamical structure as its label code q(C), obtained 
by the natural map qk : C\{k] ~^ C|{fe}/C|.{fc} of each output 
group C|{fc} of C onto its label group. C is said to have abelian 
dynamics if all label groups are abelian, for then and only then 
all state spaces Sj'(C) are abelian [15]. 

We define the output sequence space of C as the direct 
product (or whatever product/sum is appropriate) of the output 
groups, >V(C) = rifeeJ the nondynamical sequence 
space as the product V{C) ~ Ilfeei^hife}- 

Theorem 5.7 (abelian dynamics theorem): If C is an alge- 
braic group code in the sense of [15], then C has abelian 
dynamics if and only if C is normal in its output sequence 
space W{C). 

Proof. If C has abehan dynamics, then W(C)/V(C) = 
T\keT I is abelian. Thus C/V{C) is an abelian and 
normal subgroup. By the correspondence theorem, C is normal 
in W{C). 

Conversely, if C is a normal subgroup of yV(C) = x 
rife'ei-ffc} ^^^^ fortiori C is normal in C|{fcj x 

C|i-{fc}, since C\x-{k} ^ Ilk'ei-{k} Therefore, by the 

previous theorem, the label group C^yk}/C\:{k} (which is the 
state space S{fci,(C)) is abelian, for any k E 2. Since all label 
groups are abelian, C has abelian dynamics. □ 

A syndrome -former for C is a dynamical map defined 
on the output sequence space W(C) (or a larger sequence 
space) whose kernel is C. It follows from this theorem that 
a syndrome-former can be homomorphic if and only if C 
has abelian dynamics. However, as we see from the example 
of a state difference map, a syndrome-former can be non- 
homomorphic while still being straightforward and essentially 
group-theoretic. Thus our assumption of abelian dynamics 
in this paper is not fundamental, as the syndrome-former 
constructions of Fagnani and Zampieri [10] show. 

VI. Notions of finite memory 

In this section we discuss several notions of finite memory, 
and study their duality properties in a group-theoretic context. 
Most of these notions have been introduced previously in 
behavioral system theory [47] in a set-theoretic context. 

We first introduce L-controllability and L-observability, 
which turn out to be duals. We give two characterizations of 
each, which are also duals. We then introduce L-finiteness 
and L-completeness, also duals, and show that they are equiv- 
alent to L-controllability and L-observability, respectively, in 
appropriate settings. 

To discuss memory, we must assume that the time index set 
T is ordered; i.e., without loss of generality, X C Z. We will 
use the notation of [15] for subintervals of 2; e.g., 

[m, n) = {k'E2\m<k< n}; 
= {k Cz 2 \ k < to}; 
n+ = {ke2\k>n}. 

Thus 2 is the disjoint union of the three subintervals 

{to^, [to, n), n^}. 
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Figure 6.1. Illustration of [m, n) -controllability 
with code sequences c, c' and c". 
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Figure 6.2. Illustration of [m, n)-observability 
with code sequences c, c' and c". 



A. Strong controllability and observability 

We now study the duality between notions of strong control- 
lability and observability. Our definition of strong controllabil- 
ity is the same as that of Willems [47]. Our definition of strong 
observability (introduced in [28]) corresponds to WUlems' def- 
inition of "finite memory.'"' We show that these two notions are 
duals. We also show that strong controllability or observability 
implies controUabiUty or observability, respectively, as defined 
earUer. 

Given a finite interval [m, n), a code C is [m, n)- 
controUable if for any c, c' e C there exists a c" G C such 
that c!' _ = ci^- and c'.'+ = c'... A code is L-controllable 

777' I 

if it is [m, m + L)-controllable for every length-L interval 
[m, m + L), and strongly controllable if it is i-controllable 
for some L. The least such L is the controller memory of C. 

The following controllability test follows directly from the 
definition. 

Theorem 6.1 (first [m, n)-controllability test): A code C is 
[m, n)-controllable if and only if C\x-[m,n) = C\m- x C\n+- 

Proof. This merely restates the definition; it says that C is 
[m, n)-controllable if and only if any past in Cj^- can be 
Unked to any future in C|„+. □ 

If C is a group code, then we have an alternative controlla- 
bility test: 

Theorem 6.2 (second [m, n)-controllability test): A group 
code C is [to, n) -controllable if and only if C = C.„- + C.„j+. 

Proof. If C is generated by C.„- and 0.^+, then any past 
c\m- can be linked to any future C|„+ as follows: find any 
c~ € C-n- and c+ 6 C.m+ such that (c~)|„j- = C|m- and 
{c'^)\n+ = C|n+; then c~+c"'" is the desired finking sequence. 
Conversely, if C is [to, n)-controllable, then any c~ € C:m- 
can be linked to G C.„+, and any c+ e C.„+ can be linked 
to G C.„-, which imphes that C = C.„- + 0..^+. □ 

The definition of [to, n) -controUabiUty, illustrated in Figure 
6.1, involves a notion of finite reachability: from any state 
(set of past trajectories) at time to we can reach any state (set 
of future trajectories) at time n. The first [to, n) -controUabiUty 
test translates this into a notion of memorylessness: the state at 
time n is not constrained by the trajectory before time to. The 
second [to, n)-controllability test reUes on the group property, 
by which it suffices to show that every state at time m can 
reach the zero state at time n and every state at time n can 
be reached from the zero state at time to; it then translates 
this observation into the statement that every code sequence 
can be decomposed into a code sequence in C.„- and a code 
sequence in (7.^+ , which is a generatabiUty criterion. 

"^In [49, p. 336], Willems calls this notion "insightful" for discrete-time 
behaviors. 



We define a code C to be [m, «)-observable if whenever 
C|[rn,n) = for c, c' G C, then the concatenation of 

C|m-,C|[„,„) = c\,y and cj„+ is in C. A code is L- 
observable if it is [to,, to, + L)-observable for every length- 
L interval [to,to + L), and strongly observable if it is L- 
observable for some L. The least such L is the observer 
memory of C. 

The following observability test follows directly from this 
definition: 

Theorem 6.3 (first [m, n)-observability test): A code C in a 
sequence space W is [to, n)-observable if and only if 

C = {w G W I W|„- G C|„-,W|„+ G C\m+)- 

Proof If C = {w G W I W|„- G C|„-,W|„,+ G C|„+} 
and c, c' G C have a common central segment C|[„j „), then 
w = (cjm- , C|[m,n), C|^+) satisfies the constraints W|„- G 
C|„-,W|m+ G C\m+ and is therefore in C, so C is [m,n)- 
observable. Conversely, if C is [to, n)-observable, then the fact 
that if c, c' G C have a common central segment c\[jn,n) then 
w = (c|„- , C|[„ „), cjj^+) is a code sequence implies that any 
sequence w G >V whose restrictions vv|„- and W|„+ equal 
restricted code sequences C|„- G C|„- and c\m+ € C\m+y 
respectively, is a vaUd code sequence. □ 

If C is a group code, then we have an alternative observ- 
ability test: 

Theorem 6.4 (second [m, n)-observability test): A 
group code C is [to, n)-observable if and only if 

^■.I— [171,1%) ~ ^:m^ X 

Proof In general, C:„- x C.„+ C C./„ If c G 
C:/-[m.n)' ^cn C[[„,.„) = 0|[„^„). Siuce G C, if C is [m,n)- 
observable, then the concatenations {c\m- ^0^^+) = Pm-{c) 
and (0|„-,C|„+) = P„+(c) are in C, and thus in C.^- and 
C.„+, respectively. So C.j-[jn,n) ^ C.^- xC.„+, which implies 
that = C.jji- X C.JJ+. 

Conversely, if c, c' G C are such that C|[„ „) = c'j^ then 
c - c' G C,i-[m,n)- If = C.„- X C.„+, then c - c' 

may be written as c — c' = c~ -|- c+, where c~ G C.^- and 
c+ G C.„+. It follows that 

P„,- (c) + P„+ (c') c' + P„- (c - c') = c' + C-, 

which by the group property of C is in C. So C is [m,n)- 
observable. □ 
Our definition of [to, n)-observability, illustrated in Figure 
6.2, is implicitly a notion of state observability: given a 
segment of a code sequence C|[„ „), the states at time to 
and n (and indeed during the entire interval [to,, n)) are 
determined. The first [to, n) -observability test translates this 
into a checkabiUty criterion: if a sequence looks like a code 
sequence during the overlapping intervals n~ and to+, then 
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it is a code sequence. The second [m, n)-observability test 
relies on the group property, by which it suffices to show 
that C|[„ „) = 0|[m,n) impHes that c G C passes through the 
zero state at times m and n (and therefore during the entire 
interval [m, n)); it then translates this observation into the 
statement that every code sequence with C|[„i „) = 0|[„j „) can 
be decomposed into a code sequence in C.„j- and a sequence 
in C.„+, which is another notion of memorylessness. 

Our desired duality theorem then follows directly from pro- 
jection/subcode duality, applied to either of two dual pairs of 
tests. The first proof shows that the first [rn, 7i)-controllability 
test and the second [m, n) -observability test are duals, whereas 
the second proof shows that the second [m, rt)-controllability 
test and the first [m, n) -observability test are duals. 

Theorem 6.5 (strong controllability /observability duality): 
Given dual group codes C, and a finite interval [m, n) C X, 
C is [m, n) -controllable if and only if is [m, 7i)-observable. 

First proof. By the first [to, 7i)-controllability test, C is 
[m, n) -controllable if and only if C|/_[,„ „) — C\„l- xC|„+. By 
projection/subcode duality, the duals of the left and right sides 
of this equation are (C^)|:/-[m.n) and (C^)|.,„- x (C^)|.„+, 
respectively. Therefore C|7_[m „) ~ C\„l- x C|„+ if and only 
if {C^)\:i-[m,n) = (C"^)|:m- X {C^)\,,,+ , which is effectively 
the second [to, n)-observability test for C^. □ 

Second proof. By the second [to, n) -controllability test, C 
is [to, n)-controllable if and only if C = C.„- + C.„j+. By 
projection/subcode and sum/intersection duality, the duals of 
these two codes are and (C:„-)^ n (C:m+)^, respectively. 
Furthermore, by projection/subcode duality, 

(C„-)^-{xe>V^|x|„- e(C^)|„-}; 
- {x e I x|„+ e 
so (C:„-)-'- n (C:„i+)^ is equal to 

{x e I x|„- e (C^)|„-,x|„+ e (C^)|™+}. 

But this is if and only if is [?t!, rt)-observable, by the 
first [to, n)-observability test for C^. □ 
As immediate corollaries, we have: 
Corollary 6.6: Given dual group codes C and C^, 

(a) C is L-controllable <^ is L-observable; 

(b) C is strongly controllable -i^ is strongly observable; 

(c) controller memory of C = observer memory of C^. 
This fundamental duality result provides strong support for 

our use of the term "observability" rather than "finite memory" 
in [28] and here. Also, it is desirable to distinguish between 
controller and observer memory. 

All notions of zero memory coincide: a code is 0- 
controllable or 0-observable or memoryless if for any time 
TO and any c,c' G C, the concatenation (c|„-,c|^+) is in C. 

However, if C is not memoryless, then there is no necessary 
relationship between its controller memory and its observer 
memory; these are two distinct (and dual) notions of the 
memory of C. The controller memory measures the maximum 
time needed to link any past to any future. The observer 
memory measures the maximum observation time needed to 
obtain a "sufficient statistic" for predicting the future (resp. 
the past) from the past (resp. the future). 



Finally, we now verify that strong controllability (resp. 
observability) implies wide-sense controllability (resp. observ- 
ability) as defined earlier. For observability, we will consider 
only the case in which all symbol groups are discrete, in 
which case the topology of the complete sequence space 
is the topology of point wise convergence. Under our 
standing assumptions, the corresponding controUabiUty result 
then holds when all symbol groups are compact. 

Theorem 6.7: Let C and be dual group codes in se- 
quence spaces W and >V~, respectively. Let all symbol groups 
Gfe of be discrete, and all symbol groups Gk" of {W^)" 
be compact. Then C is observable if C is strongly observable, 
and is controllable if is strongly controllable. 
Proof. Suppose C is strongly observable but not observable; 
i.e., {C'^)f 7^ Cf. Then there exists some finite sequence w G 
(C^) / that is not in C/. Since the topology of is the topology 
of pointwise convergence, this means that there is some series 
{c"} of code sequences c" G C that converges pointwise to 
w as n oo. Now C is L-observable for some integer L, 
and the support of w is some finite interval [k, k'). Pointwise 
convergence then implies that c'^n.-L.k' +l) ^ ^\[k-L,k'+L) 
for all sufficiently large n. But L-observability then implies 
that w is a finite code sequence in C, since C||j,_^ k'+L) ^ 
code sequence that agrees with the all-zero sequence during 
the length-L intervals [k — L, k) and [fc', fc + L); contradiction. 
Thus C must be observable. 

Finally, is controllable if and only if C is observable by 
Theorem 14. 81 and is strongly controllable if and only if C 
is strongly observable by the corollary above. □ 

On the other hand, the following example shows that a 
controllable code need not be strongly controllable, and an 
observable code need not be strongly observable. 

Example 6. Let I = {1, 2, . . .}, and let C be the group code 
over a group G in which the symbols Ck are chosen freely 
from G at times k — 2" for all n G {0, 1, . . .}, but at all other 
times Cfc = Ck-i- Then C is generated by finite sequences 
of the form (. . . , 0, g, g, . . . , g, 0, . . .) with support [T\ 2"+^) 
and is thus controllable, but C is not L-controllable for any L G 
Z. The dual subcode is thus observable but not strongly 
observable. □ 

B. L-finiteness and L-completeness 

In this subsection we introduce L-finiteness and L- 
completeness, which turn out to be duals. Our definition of 
L-completeness is the same as that of Willems [47], except 
for the modification that we made earlier when defining 
completeness; it is a notion of finite checkability in complete 
sequence spaces. We define L-finiteness in a dual way as 
a notion of finite generatability that applies to group codes 
in finite sequence spaces. We show that in these restricted 
contexts L-finiteness is equivalent to L-controllability, and L- 
completeness is equivalent to L-observability. 

We define a group code C in a finite sequence space Wf 
to be L-finite if it is generated by its finite code sequences of 
length L + 1: 

^ ~ ^ C:lk,k+L]- 

kez 
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In other words, C is L-finite if and only if any c G C may be 
decomposed into a sum of code sequences C[j, jr.^^j e C.j/j j.^^] 
whose supports are intervals of length L + 1: 

C = ^ Clk,k+L]- 

fcez 

Notice that this definition makes sense only in the setting of 
group codes; no analogue exists for set-theoretic codes. 

The following theorem shows that for such group codes, 
i-finiteness is equivalent to i-controUability: 

Theorem 6.8 (L-finite = L-controllable + finite): If C is a 
group code in a finite sequence space W/, then C is L-finite 
if and only if C is L-controllable. 

Proof. If C is i-finite, then we may write any c G C as 
c = X^jez ^[i.j+i]' f*^'" ^'^y ^' written as a sum 

c = C(fc+L)- +Cfc+ with C(fe+i)- G C:(fc+L)- and Cfc+ G C.,k+, 
as follows: 

j<k j>k 

Thus C = C:(fe+i)- + C-k+, so by the second [m,n)- 
controllability test C is [k, k + L)-controllable for all fc, and 
thus L-controllable. 

Conversely, let C be L-controllable. Since all code se- 
quences are finite, the support of any c G C is a finite interval, 
say [/c, fc' + L]. By L-controllability, for any j G Z there exists 
a Cj+ G C.j+ such that — 0|j- and {Cj+)\(j+L)+ = 

C|(j+L)+. Then Cf^-j+ij = Cj+ - (c(j+i)+ has support 
[j,i + L\- Thus for any c G C we have c Eje[fe,fe'] ^b.^+L]; 
so C is L-finite. □ 

Dually, a group code C in a complete sequence space W 
will be defined as L-complete if 

C = {w G I ^\[k,k+L] e {C\[k,k+L]f^ for all k G Z}. 

As in our definition of completeness, this definition uses closed 
restrictions {C\[k,k+L]Y'^ ■ If the closed-projections assumption 
holds, then this reduces to Willems' definition [47]. In other 
words, C is L-complete if whenever w G W"^ looks like a 
code sequence through all windows of length L + 1, then w 
is in fact a code sequence. 

The duality of L-completeness and L-finiteness then follows 
directly from projection/subcode duality: 

Theorem 6.9 (L-finiteness/L-completeness duality): If C 
and are dual group codes in dual finite and complete 
sequence spaces W/ and (W/)", then C is L-finite if and 
only if is L-complete. 

Proof. By sum/intersection duality, C — X^fcez 
and only if = nfeez(^:[fe,fe+i] projection/subcode 
duaUty, (C:[fe,fe+L])^ is the closure of 

{x G {WfY I X|[fc^fc+i] G (C-^)|[fc,fe+L]}. 

Then 

= {x G (W/)" I {■^\[k^k+L]f' e {C%k,k+L] for all fc}, 

which is the definition of L-completeness for C^. □ 

Corollary 6.10 (L-complete = L-observable + complete): 
If C is a (complete) group code in a complete sequence space 
yV^, then C is L-complete if and only if C is L-observable. 



Proof. We have now shown that the following are equivalent: 

C is L-complete 4^ is L-finite <^ 

is L-controllable <^ C is L-observable. □ 

This is a group-theoretic version of Willems' set-theoretic 
theorem [47] that a complete code is L-complete if and only 
if it has L-finite memory (is L-observable). 

While L-finiteness and L-controllability are equivalent 
(resp. L-completeness and L-observability), the tests that they 
imply are different in practice, as we show by revisiting the 
controllability and observability tests of Subsection I VI- Al and 
then applying these tests to our examples. 

The tests of Subsection IVI-AI involve a three-way partition 
of the time axis X, namely X — {m~, [to, n),n+}. We may 
correspondingly identify X with an equivalent finite time axis 
X' = {1,2,3} of length 3, and we may regard any code 
C defined on Z as a code C defined on X'. Note that the 
equivalent length-3 sequence space W' — W\m- x W|[m.„) x 
W|„+ is both complete and finite, assuming that each of the 
restrictions W|m- , >V| and W|„+ is complete (closed). 

Now in terms of the equivalent code C on I', we have: 

• C is [to, n) -controllable <^ C' is l-controllable; 
> C is 1-conti-ollable <^ C||^ gj = C||^| x C'^^^y, 
. C is l-finite ^ C = C'^^_2} +<^:{2,3}- 

The latter two tests correspond to our first and second [to, n)- 
controllability tests, respectively, and their equivalence follows 
from Theorem 16.81 Similarly, 

• C is [to, rt)-observable <^ C is l-observable; 

• C is l-observable <^ C'^^ = C'^-^j x C^^y, 
m C' is l-complete <^ 

C = {w G W I w|{i^2} e C[^i,2},w|{2,3} e C\^23])- 
These two tests correspond to our second and first [to, n)- 
observability tests, respectively, and their equivalence fol- 
lows from Corollary 16.101 or by duality from our [to, n)- 
controllability tests. 

Now let us see how these various tests apply to some of 
our example codes. 

Example 2 (cont.) A bi-infinite repetition code C over G is 1- 
observable, because two code sequences that agree anywhere 
agree everywhere. It is l-complete, because a sequence w is 
in C if and only if the two components of every length-2 re- 
striction W|[;j jj+i] are equal. The zero-sum code over is 
l-controllable, because for any two finite sequences x, x' and 
any fc G Z, there is an /i G G' such that (x|j.-, ft,, (x')|(i.+i)+) 
is in C^. It is l-finite, because it is generated by its length-2 
sequences (...,0,5, —g, 0, . . .). □ 

Example 3 (cont.) The finite subcode C/ of the rate- 1/3 
linear time-invariant convolutional code C over Z4 com- 
prising all linear combinations of time shifts of g = 
(. . . , 000, 100, 010, 002, 000, . . .) is by definition 2-finite and 
evidently 2-controllable, since it has a feedbackfree encoder 
with memory 2. The finite subset (C^)/ of its dual rate- 
2/3 code comprising all linear combinations of time 
shifts of the generators hi = (. . . , 000, 100, 030, 000, . . .), 
ha = (. . . , 000, 020, 001, 000, . . .) is by definition l-finite and 
evidently l-controllable. 
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C is 1 -complete, because it is the set of all sequences 
orthogonal to all shifts of the length-2 sequences hi and h.2. C 
is 1 -observable, because a zero symbol 000 can be observed 
only if C is in the zero state. Similarly, is 2-complete, 
because it is the set of all sequences orthogonal to all shifts 
of the length-3 sequence g, and it is 2-observable since two 
successive zero symbols (000, 000) can be observed only if 
is in the zero state, as the reader may verify. □ 

Example 4 (cont.) Loeliger's code C is 1 -observable, since 
two code sequences with the same output Ck have a uniquely 
determined past and the same set of possible futures. It is 1- 
complete, because a sequence w is in C if and only if the first 
component of every length-2 restriction w^^^-j^^i] is twice the 
second component (mod Z). Its dual is generated by the 
time shifts of the length-2 generator h=(...,0, 1,-2,0,...), 
and thus is by definition 1 -finite; it is 1 -controllable since it 
evidently has a feedbackfree encoder with memory 1 . □ 

VII. Dual granule decompositions 

The development of [15] is based on a decomposition of 
an L-controllable group code C according to a chain of j- 
contro liable subcodes Cj, 

Co c Ci c . . . c Cl = C, 

and then a further decomposition of the quotients Cj/Cj-i 
into direct products of jth-level granules, defined (in additive 
notation) as 

i [k,k+j][<^) - —p • 

We now give a dual decomposition of an L-observable 
group code C according to the j-observable supercode chain, 

C = C^ cc^-i c ••• cc", 

and then a further decomposition of the quotients C^^^/C^ 
into products of jth-level observer granules ^ik,k+j] (C). Here 
the "granules" r[fc fc+j](C) of [15] will be called "controller 
granules." 

We will show that the j-observable supercode of C is 
the dual of the j-controllable subcode {C^)j of its dual C^, 
and that the observer granules of C act as the character groups 
of the corresponding controller granules of C-*". 

In the following section, we will give examples of how 
this observability structure can be used to construct mini- 
mal observer-form encoders, state observers and syndrome- 
formers. A general construction of syndrome-formers for 
non-topological group codes over finite, possibly nonabelian 
groups that uses this observability structure is given in [10]. 

A. Controller decomposition 

We review the results of [15] in our topological group 
setting, to prepare for dualizing them. 

From here on, for simplicity, when we denote a sequence 
subspace in a sequence space W by a Cartesian product, e.g., 
Ylkex ^fc' imply that the product is of the same type as 
that of W — e.g., a direct product, Laurent product, or direct 
sum. 



As in [15], we define the j-controllable subcode Cj of a 

group code C in a sequence space W as the code generated 
by the length-(j + 1) subcodes C.^k k^j] of C: 

Cj = y^^C.,\k,k+j]- 

If W is finite, then Cj by definition is j-finite. By a proof 
like that of Theorem 16.81 Cj is j-controllable, and C is L- 
controllable if and only if C = Cl. 

If C is i-controllable, then we have a chain of j-controllable 
subcodes 

{0} C Co C Cl C ■ • • C Cl = C. 

For consistency in indexing, we may denote the trivial subcode 
{0} by C_i. 

The O-controUable subcode Co (called the parallel transition 
subcode of C) is a memoryless sequence space of the same 
type as W, whose symbol groups are the length- 1 subcodes 
C:{fe}. Since it is memoryless, it has trivial dynamics (i.e., 
trivial state spaces). 

The controller granules fc+j](C) are defined by 

T[k,k+j]iC)^ (^^■):tfc.fc+j] ^ keI.,0<j<L. 

m-lJ:[/c,A;+j] 

Since {Cj);[kM+]] = C:[k,k+j] and {Cj-i);[k,k+j] = C;[k,k+j) + 
C:(fe,fc+j], this is equivalent to the definition of [15]: 

r[w](C) = j; , 1<J<L; 

^■.[k,k+j) + '^■.(k,k+j] 
r[fc,fc](C) = C:[fe^fe] = C:{A;}. 

The cosets of {Cj-i):[k.k+j] in {Cj);[k,k+j] are represented by 
sequences in C:[k^k+j] that are not in the (j — l)-controllable 
subcode Cj_i. The zeroth-level controller granules Fj^. fc](C) 
are called "nondynamical granules" and are equal to the 
parallel transition subgroups C.^f^y. 

As in the code granule theorem of [15], we can then show 
that 

-^ = l[^[k.k+,]{C), 0<J<L, 

^ ^ kei 

where the product is a direct product, Laurent product, or 
direct sum according to the character of the sequence space 
yy in which C lies. The proof essentially follows from the 
facts that Cj/Cj-i is generated by the sequences in C.[k,k+j] 
that are not in Cj_i for all k £ Z, and that {Cj)-[k^k+j+i] is 
the direct product of {Cj):[k^k+j] and {Cj):[k+i^k+j+i] modulo 
Cj_i, since the intersection of {Cj).,[k^k+j] and {Cj).,[k+i,k+j+i] 

is iCj):{k,k+j] ^ Cj_l. 

The restrictions of the future subcodes (Cj).j,+ to time k 
are defined as the jth-level first-output groups 

F,MC) = {{Cj):k+)\{k}, 0<j<L, 

which form a chain 

{0} C i^o,fc(C) C Fi^fe(C) C . . . C FlAC) - FkiC), 

where Fk{C) = (C.k+)\{k} is the first-output group of C at 
time k (also called the input group [15]). Since Fj k{C) — 
{C-[k^k+j])\{k} and the kernels of the restrictions to {k} of 
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{Cj):[k,k+j] and {Cj-i).[k,k+j] are both equal to C,(k^k+j], it 
follows from the correspondence theorem that the quotients 
of this chain are isomorphic to the corresponding controller 
granules: 

Similarly, we define the yth-level last-output groups as 

LjAQ = ((Cj):(fc+l)-)|{fc}, 0<j<L, 

which form a chain up to Lfe(C) = {C.^k+i)-)\^hy, the last- 
output group of C: 

{0} C Lo,fc(C) C Li,fc(C) C . . . C LlMQ = Lk{C), 

with quotients also isomorphic to controller granules: 



Lj-i,k{C) 

The state code of C is the group code cr(C), where the state 
map a is the Cartesian product of the state maps ak', i-c, 

cr(c) = {crfc(c), k e Z}, 

where cr/c(c) G S/c(C) is the state of the code sequence c € C 
at time k. The kernel of the state code map is the parallel 
transition subcode Cq. 

As in [15], the state spaces and state code of C may be 
decomposed according to the chains 

{0} = afc(Co) C afc(Ci)C...Cafc(CL) = Sfc(C); 
{0} = <t(Co) C (t{Ci)C...C(t{Cl)=(t{C), 

where (Jk{Cj) is the state space of the j -controllable subcode 
Cj at time k and <T{Cj) is the state code of Cj. The zeroth-level 
state code <t(Co) is trivial since Co is memoryless. 
The quotients of the latter chain are isomorphic to Cj/Cj-i: 



o-(C,-_i) C 



The quotients of the former chain are isomorphic to direct 
products of the jth-level controller granules that are "active" 
at time k: 



ak{C. 



ie[k-j,k) 



l<j<L. 



Each single controller granule Ffj. fc+jj (C) may be im- 
plemented by a little state machine with an input group 
and a state space isomorphic to T^i~^i~_^.j-^{C) which is ac- 
tive during the interval (fc, k + j], as follows. An input 
in Fj,k{C) / Fj^i,k{C) = r[fefe_|_j](C) arrives at time k and 
determines a corresponding first output, which is the time-A: 
output symbol of a representative of the corresponding coset of 
{Cj-i)-[k.k+j] in {Cj);[k.k+j], as well as a corresponding state 
in a state space isomorphic to Ffj; (C) at time k+1. During 
the interval {k,k + j], the state is constant, and determines 
the remaining output symbols of the representative sequence. 
At time k + j, the last output is emitted (a representative 
of Lj^k+j{C)/Lj--L,k+jiQ = T[k,k+j]{C)), and the granule 
becomes "inactive;" i.e., no further memory is required. 



A jth-level encoder for Cj/Cj-i in controller form may 
then be implemented by combining the outputs of encoders 
for r[fc fe+j](C) for all fc G Z (with finite or Laurent 
constraints, if appropriate; e.g., that there be only finitely 
many nonzero inputs for A; < 0). The resulting encoder 
implements an isomorphism from the "input sequence space" 
rifc -Pj,fc(C)/-P,-i,fc(C) = Ilk^lk.k+j]{C) to the output space 
Cj/Cj-i = Y\k^[k,k+j]iC). The state space of the jth-level 
encoder at any time is isomorphic to ak{Cj)/ak{Cj-i) and is 
thus minimal. 

Since the parallel transition subcode Co = nA;^:{A;} ^ 
memoryless sequence space, the zeroth-level encoder for Cq 
requires no memory; the output is simply a complete, Laurent 
or finite sequence of elements from the parallel transition 
subgroups Fo,fe(C) = C.{fc}, fc € Z. 

Finally, a minimal encoder for C in controller form may be 
implemented by adding the outputs of all jth-level encoders, 
< j < L. Such an encoder implements a one-to-one 
correspondence from Fk (C) to C, but not necessarily an 
isomorphism [15] (see also [28], [29]). 

B. Controllable and uncontrollable codes 

We now extend the results above to codes C QW that are 
not necessarily strongly controllable. For simplicity, we take 
W to be a complete sequence space. 

We then have a chain of subcodes 

{0} c Co c Ci c . . . c [Cf Y c C, 

where Cj is the j-controllable subcode of C, j > 0, and {CfY 
is the controllable subcode of C. We recall that C is controllable 
if and only if [CfY = C. 

Since {CfY is the (closure of the) code generated by all 
finite subcodes of C, 

{CfY= E 

finite iT" 

it is clear in the topological setting that {CfY may be regarded 
as the "limit" of the j-controUable subcodes Cj as j oo. 
For instance, if the symbol groups are discrete, then {CfY is 
the code consisting of the limits of all finite sequences in C 
in the topology of pointwise convergence. 

C is therefore controllable if and only if every sequence in 
C can be expressed as such a limit of finite code sequences. If 
C is uncontrollable, then the code sequences not in {C/ Y not 
only are not finite, but also are not the limit of any series of 
finite sequences in C. For example, in Examples 2 and 4, the 
only finite sequence in C is 0. 

Again, there are state space and state code chains as follows: 

{0} C ak{Ci)C...Cak{{CfY)^<Jk{C) = ^k{C); 
{0} C CT{C^)C...Ca{{CfY)CcT{C). 

Since C/{CfY = a-{C)/cr{{CfY) (because the kernel Co of 
the state map is a subcode of both {CfY and C), it follows 
that {CfY = C if and only if a{{CfY) = cr{C): 

Theorem 7.1 (dynamical controllability test): A complete 
group code C is controllable if and only if cr{{CfY) = <^{C)- 
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In other words, finitization preserves the dynamics of C if 
and only if C is controllable. 

Let C be time-invariant, so that all state spaces S/c(C) 
are congruent to So(C), and suppose that So(C) satisfies the 
descending chain condition (DCC). Then C is complete [29, 
Prop. 3.6]; moreover, by the DCC, there can be only a finite 
number of steps in the state space chain, which implies that the 
controllable subcode {CfY is strongly controllable (see [28], 
[29]). Thus we have: 

Theorem 7.2: If C is a time-invariant group code whose 
state space So(C) satisfies the descending chain condition, 
then {CfY is strongly controllable. Thus C is controllable if 
and only if C is strongly controllable. 

Example 6, in which C is controllable but not strongly 
controllable even though the state space is never larger than 
G, shows that time-invariance is essential. 

Theorem 17.21 has been extended to time-invariant group 
codes over finitely generated abelian symbol groups in [6], and 
to time-invariant ring codes over finitely generated modules 
over a principal ideal domain in [9]. All versions of Theorem 
17.21 depend on some sort of finiteness condition. 

The basic structure theorem of Miles and Thomas [30] (see 
[6]) says that if G is a compact abelian Lie group and C C G^ 
is a closed time-invariant group code over G, then there exists 
a finite chain 

{0} c Co c Ci c • • • c Cl = {CfY CC" cc 

of closed normal time-invariant subcodes of C, where 
Cj/Cj-i = {GjY for some compact Lie group Gj (in our 
setting, Gj may be identified with the jth-level controller 
granule T^i^j^^j-^); /{CfY is a solenoid (a compact connected 
abelian group of finite topological dimension), as in our 
Example 4; and C/C is autonomous (a semi-simple Lie 
group), as in our Example 2. Using this theorem. Kitchens 
and Schmidt [24] show that if C is a compact controllable 
time-invariant group code whose state space Eo(C) satisfies 
the DCC, then C is strongly controllable. 

C. Observable and unobservable codes 

An observer decomposition of C may be obtained by simply 
"dualizing" the controller decomposition just described. 

The j-observable supercede C^ of a group code C in a 
sequence space W is defined as 

C^' = {w e >V I ^\[kM+o] e C\[uM+j] for all fc e Z}. 

If W is complete, then by definition is j-complete. 

By projection/subcode duality, we have: 

Theorem 7.3 (subcode/supercode duality): If C and are 
dual group codes, then the j-observable supercode of C"*- is 
the dual of the j-controllable subcode of C: 

{c^Y = (c,)^. 

It follows that G^ is j-observable, and that C is i-observable 
if and only if C = C^. 

Since the dual of the controllable subcode {CfY of a 
complete code C is the observable supercode {{C^Y)f of the 



finite code C^, we have for a finite code C a supercode chain 
dual to the subcode chain of C^: 

C C (C")/ C • • • C C C° W{C) C Wf. 

Again, by duality (C"^)/ is the "limit" of the j-observable 
supercodes C^ as j — > oo. 

Each of these supercodes has well-defined state spaces S^, 
which are trivial in the case of the memoryless supercodes 
— W{C) and W/, and well-defined state maps ak and 
c = {cfc, k £ T}. By dualizing Theorem 17. II we obtain: 

Theorem 7.4 (dynamic observability test): A finite group 
code C is observable if and only if cr((C^)/) = cr{C). 

In other words, completion preserves the dynamics of C if 
and only if C is observable. 

Also, by dualizing Theorem 17.21 we obtain: 

Theorem 7.5: If C is a finite time-invariant group code 
whose state space So(C) satisfies the descending chain con- 
dition, then (C^)/ is strongly observable. Consequently, C is 
observable if and only if C is strongly observable. 

D. Observer granule decomposition 

Now let C be a general finite, Laurent or complete L- 
observable group code. Then we have an ascending j- 
observable supercode chain: 

C = c C^-i c • • ■ c C" = W{C) c W. 

For indexing consistency, we denote W by C^^. 

The 0-observable supercode = Ofc'^Kfc} '^he output 
sequence space W(C), a memoryless sequence space of the 
same type as W. 

By Theorem l7.3l this chain is dual to the subcode chain of 
the dual code C^: 

(C^)_i = {0} C (C^)„ C (C-L)i C . . . C {C^)l = C^. 

By quotient group duality, the quotients of the latter chain act 
as the character groups of the quotients of the former: 



c^- 



0<j<L. 



Note that the output sequence space >V(C) = acts as the 
character group of the parallel transition subcode (C-'-)o, and 
that yy(C) = W if and only if (C^)o = {0}. Dynamically, C 
should be regarded as lying between the memoryless sequence 
spaces Co and >V(C), rather than between {0} and W. 
Trimming the sequence space >V to >V(C) is dual to factoring 
out the parallel transition subcode to yield the dynamically 
equivalent "label code" q(C) ^ C/Cq [15]. 
Since 



lk,k+j] 



{C 



it follows from direct product/direct sum duality that 



Ci 



-'W'^[k,k+j]{C^ 



where as usual the indicated product denotes a direct product, 
Laurent product, or direct sum according to the character of 

yy. 
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Since the controller granule Fj^, j.^^] (C-*") is defined as a 
quotient group, it is natural to define the observer granule 
$[fc_fe+j](C) as the dual quotient group: 



(6 (r\ - ('^ )|[fc,fc+j] 



k €Z,0 <j < L. 



For < j < L, {C')i[k,k+j] = C\[k,k+j], so the cosets of 
{C-')\[k,k+j] in {C^^^)\[k.k+j] are represented by sequences in 
{C^~^)\[k,k+j] that are not in Ci[k,k+j]- 
For 1 < j < L, we may write {C^~^)\[k,k+j] 

{w e W I w|[fe,fc+j) e Ci[k,k+j),^\{k,k+j] e C|(fe,fc+j]} 
= (C|[fe,fe+j) X Wnk+j}) n (>V|{fe} X C|(fe_fe+j]). 

In other words, fe+jj (C) is the quotient of the subset of 
sequences in W\[k^k+j] that satisfy the checks of C on the 
intervals [k, k + j) and (fc, k + j] with the subset that checks 
on the entire interval [k.k + j]. 

For j = 1, we have (C")|[fe,fe+i] = C\{k} x C\{k+i}, so 

«'[fe,fe+i](t-j 7; • 

In other words, $[fe.fe+i](C) is the reciprocal state space of 
Cp,fe+i] as a length-2 code. 

For j = 0, we have {C-^)\[k,k] = Gk and {C°)\[k,k] = 
so the zeroth-level (nondynamical) time-fc observer granule is 

^[M](C) = p^- 
C|{fe} 

Now in summary, having defined observer granules to be 
dual to controller granules, we obtain our main duality and 
decomposition theorems: 

Theorem 7.6 (granule duality): If C and are dual group 
codes, then the observer granule (C) acts as the 

character group of the controller granule r[fe_fe_|_j] (C""-): 

r[fe,fe+j](c-^)^ = $[fe^fc+j](C). 

Proof. Follows from quotient group duality, projec- 
tion/subcode duality, and subcode/supercode duality. □ 

Corollary 7.7 (observer granule decomposition theorem): 
If C is a complete (resp. Laurent, finite) group code, then 
C^~^ /C^ is isomorphic to the direct product (resp. Laurent 
product, direct sum) of the observer granules $[fc_fc_|_j](C): 

=X{'^[k,k+j]{C), i>0. 

k 



Thus we may decompose a sequence in W according to the 
j'-observable supercode chain into a sequence in C and repre- 
sentatives of C^~^/C^,0 < j < L, and then decompose each 
of these into a product of observer granule representatives. 

Example 2 (cont.) The bi-infinite zero-sum code C"*- over G~ 
is 1 -controllable. Its O-controUable subcode is {0}, and its 

1 -controllable subcode is itself. Its only nontrivial controller 
granules are therefore the first-level granules T\^i^^k+i]{C'^) = 
{C^):[k,k+i], each of which is a group of length-2 sequences of 
the form (. . . , 0, h, —ft, 0, . . .) with h G G', and is isomorphic 
to G'. C""- is the code generated by all finite sums of such 
sequences, and thus is isomorphic to the finite sequence space 
((GT)/- 



The dual bi-infinite repetition code C over G is 1 -observable. 
Its only nontrivial observer granules are the first-level granules 
*i?[fc,fe+i](C) = (C|{fe} X C\{k+i})/C\[k,k+i]- Now C|{fc} X 
C|{fe+i} is the set of all pairs {{g,h),g,h G G}, while 
C|[fc,fc+i] is the set of aU repeated pairs {{g,g),g G G}, so 
^[k,k+i] (C) = G. Sets of coset representatives for ^[k,k+i] (C) 
are'{(0,g),5 G G} or {{g,0),g G G}. The quotient Vv/C is 
isomorphic to the direct product of these granules — i.e., to 
the complete sequence space G^. □ 

Example 3 (cont.) Here the rate- 1/3 convolutional code C is 2- 
controUable and 1 -observable, while its dual rate-2/3 code C"*" 
is 1 -controllable and 2-observable. The zeroth-level controller 
granules of C-^ are generated by (. . . , 000, 002, 000, . . .) and 
are isomorphic to Z2; the first-level controller granules are 
generated by generators hi = (. . . , 000, 100, 030, 000, . . .), 
which has order 4, and = {. . . , 000, 020, 001, 000, . . .), 
which has order 2 modulo the zeroth-level granules, so they 
are isomorphic to Z4 x Z2. This confirms that the state space 
So(C-'") is isomorphic to Z4 x Z2. 

It follows that C has nontrivial observer granules at levels 
and 1 isomorphic to Z2 and to Z4 x Z2, respectively. Indeed, 
C|{fe} is the 32-element subgroup Z4 x Z4 x 2Z4 of the 64- 
element group Gk = (Z4)^, so the nondynamical length- 1 
granules Gk/C\^k} are isomorphic to Z2; a nonzero coset 
representative is 001. We verify that the length-2 observer 
granules <i>[k,k+i]iC) = iC\{k} x C^)^k+i})/C\[kM+i] have order 
8, since |C||fc} x C\^k+^\ = 32 x 32, whereas |C|[fc_fe_,_i]| = 
8x4x4 (the number of states times the number of input pairs). 
A set of coset representatives for C|[fejt+i] in C^^^} x C^^^+i} 
is generated by (000,010) and (000,002), so the length-2 
observer granules are indeed isomorphic to Z4 x Z2. 

Similarly, the first-level controller granules of C are gener- 
ated by sequences such as (. . . , 000, 200, 020, 000, . . .) and 
are isomorphic to Z2, while the second-level controller gran- 
ules are generated by g = (. . . , 000, 100, 010, 002, 000. . . .), 
modulo the first-level granules, and thus are also isomorphic 
to Z2. It follows that C""- has nontrivial observer granules for 
j = 1 and j = 2, all isomorphic to Z2, as the reader may 
verify. Since first-level granules are active for 1 time unit and 
second-level granules are active for 2 time units, this implies 
a state space of size 8. □ 

Example 4 (cont.) The dual code over Z is again 
1-controllable. As in Example 2, the only nontrivial con- 
troller granules are the first-level granules rjj, ^,+1] (C-*-) = 
which are generated by time shifts of h = 
(. . . , 0, 1, —2, 0, . . .), and are isomorphic to Z. C"*- is generated 
by all finite sums of such sequences, and thus is isomorphic 
to the finite sequence space (Z^) j. 

The primal code C over R/Z is 1-observable. Its only 
nontrivial observer granules are the first-level granules 
'^[k.k+i]{C) = (C|{fe} x C\{k+i})/C\[kM+i]- Now C\{k} X 
C^k+i} is the set of all pairs {{g,h),g,h G R/Z}, whereas 
C\[k,k+i] is the set of all pairs {(g,h) \ g = 2h mod Z}. Since 
g is determined by h, C|[fe,fe+i] = R/Z and $[fe,fc+i](C) = 
R/Z. Sets of coset representatives for C\[k,k+i] are {(<?, 0), 5 G 
R/Z} or {(0,/i/2),/i e R/Z}. W/C is isomorphic to the 
direct product of these granules — i.e., to (R/Z)^. □ 



FORNEY AND TROTT; DUALS OF ABELIAN GROUP CODES AND SYSTEMS 



23 



E. Observer granule decomposition of state spaces 

We now obtain an observer decomposition of the state 
spaces and state code of an L-observable code C by dualizing 
the controller decomposition of an L-controUable code C""", 
again using the chain of j -observable supercodes . 

Combining the reciprocal state space theorem with sub- 
code/supercode duality, we obtain the following basic result: 

Theorem 7.8 (state space duality): If C and C-^ are group 
codes, then the reciprocal state space Yi^{C^) of the j- 
observable supercode at time k acts as the character group 
of the state space Yik{{C^)j) of the j-controllable subcode 
{C^)j at time k: = Sfe((C-L)j-)~. 

Thus the ^/-observable state space <Tk{C^) is isomorphic 
to the character group of the j-controUable state space 

For the state spaces of the ascending chain of the j- 
controllable subcodes {C-^)j of the L-controUable dual code 
C""-, we have chains of inclusion maps as foUows: 

{0} ^ afc((C^)i)^---^afe((C^)i)=c7fc(C^); 
{0} - a{{C^),)^...^a{{C^)^) = CT{C^). 

This shows that (Tfe(C^) and (t{C-^) may be regarded as being 
composed of the quotient groups (Tfe((C^)j)/(7j.((C^)j_i) and 
cr((C^)j)/cr((C^)j_i), respectively. 

As discussed in Section II-F, although (Tfe((C^)j_i) is a 
subgroup of (Tfe((C^)j), the dual state space (character group) 
a}.{C^~^) is not in general a subgroup of (Tk{C^). Nevertheless, 
there still exists a decomposition into dual quotient groups. 
The adjoint chains of the above inclusion map chains are 
chains of natural maps, as follows: 

afc(C^) = Sfe(C) ^ ■•• ^ ak{C') ^ {0}; 

Moreover, Sfe(C) and cr(C) may be regarded as be- 
ing composed of the respective kernels of these maps, 
(a,((C^),)M((C^),_i))" and (^((C^),)/^((C^),_i))'. 

Dualizing our granule decompositions of these quotient 
groups and using direct product/direct sum duality, we have 



a{{C 



n l<j<L; 

iE[k—j,k) 



As we have already seen, the latter is isomorphic to C^~^/Cy 
In summary: 

Theorem 7.9 (dual state granule theorem): Let C be an L- 
observable group code, let Sfe(C) be its state space at time k, 
and let ak{C^) be the state space at time k of its j-observable 
supercode Then there exists a chain of natural maps 

afc(C^) = Efc(C) ^ . . . ^ afe(Ci) ^ {0} = ak{C°), 

whose kernels are isomorphic to direct products of the j 

observer granules $[i i+j](C), k — j < i < k, for 1 < j < L. 
Consequently there is a one-to-one correspondence between 
the state space S/j (C) and the Cartesian product of the observer 
granules {C),k - j < i < k,l < j < L. 



F. Dual first-output and last-output groups 

What is the dual to the jth first-output group Fj_k{C) = 
(C:[fe_fc+j])||;j} (which can also be thought of as the input 
group at level j at time fc)? By projection/subcode duality, 
it is the parallel transition subgroup at time k of (C^)|[/j 
In other words, Fj,fe(C)-^ is the set {{C-^),j_(_k,k+j])\{k} of 
time-fc symbols in all sequences in C-^ whose components are 
all zero during {k,k + j]. 

We therefore define the jth-level dual last-output group 
of C at time k as 

L^'''{C) = Fj^kiC)-^ = iC:i-(kM+j])\{k}- 

In other words, L^'''{C) is the set of time-fc symbols that 
can be followed by a sequence of j consecutive zeroes, or 
equivalently that can precede the zero state in (Tfe(C^ ). 

Note that i"'''(C) = C||fc}. Moreover, if C is L-observable, 
then L^-''{C) = Lk{C), because by the second [m, n)- 
observability test C:X-(fe,fe+L] = C.,^k+i)- x C.(^k+L+i)+- 

Thus the time-k dual last-output chain of C, 

Lk{C) = L^^^iC) C L^-^'f^iC) C • • • C lP^^{C) = C 



{fe}, 



is dual to the time-fc first-output chain of C-^. By quotient 
group duaUty, the quotients of this chain are the character 
groups of the quotients of the dual chain. These quotients are 
isomorphic to the controller granules of C""-, whose character 
groups act as the observer granules of C: 

Similarly, we define the yth-level dual first-output group of 

C at time k as 

F^'^'iC) = Lj^kiC)^ = (C/_[fc_j,fe))|{fe}- 

In other words, F^'^{C) is the set of time-fc symbols that can 
follow a sequence of j consecutive zeroes, or equivalently that 
can follow the zero state in ak{C^). 

Again we have F'^'^{C) = C|{fc}, and if C is L-observable, 
then F^'''{C) = Fk{C), since C.,j_[k-L,k) = C.^k-L)- x C.,k+. 
The time-k dual first-output chain of C, 

Fk{C) = F^'\C) C F^-^'\C) C . . . C F'^'^iC) = C\{k}, 

is dual to the time-fc last-output chain of C"*-, and the quotients 
are isomorphic to observer granules: 



$[fe-j,fc](C), 0<j<L. 



The quotient Gk/Fk{C) will be called the syndrome group 
SkiC) of C at time fc, and the quotient F^-i''=(C)/FJ''=(C) will 
be called the yth-level syndrome group S.j,k{C) at time fc, < 
j < L. The syndrome group at time fc may be decomposed 
according to the dual first-output chain at time fc into an 
element of the first-output group Fk{C) and representatives of 
the quotients F^'^^^{C) / F^'^ (C), which are isomorphic to the 
observer granules that "end" at time fc. The syndrome group 
Sk{C) acts as the character group of Lk{C-^). 
In sunmiary: 
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Theorem 7.10 (first-outputAast-output duality): If C and 
are dual group codes and C is i-observable, then the dual 
first-output (resp. last-output) chain of C at time k is dual to 
the last-output (resp. first-output) chain of C-^ at time k. In 
particular, 

F''\C) = L°'\C)=q{,y = iiC^)y,[,y)^; 
F^^\C) = Ffc(C) = (Lfe(C^))^; 
L'^-'HC) = Lk{C) ^ {Fk{C^))^ . 

The quotients of the dual chains of C act as the character 
groups of the corresponding quotients of the primal chains of 
C"*-, and are isomorphic to observer granules as follows: 

^^JJ^ = ^IW]{C), 0<j<L; 
VIII. Minimal observer-form encoders and 

SYNDROME-FORMERS 

One original objective of this paper was to develop a 
minimal syndrome-former construction based on observer 
granules for a strongly observable code C that would be dual to 
the minimal controller-form encoder construction of [15] for 
strongly controllable codes, with memory equal to the observer 
memory L. Such a syndrome-former is easily found in many 
cases: for Examples 2-4 of this paper, for codes and systems 
over fields [13], [21], and we dare say for most codes that the 
reader is Ukely to imagine. However, finding a general minimal 
syndrome-former construction that has all of the properties that 
one might desire turns out to be quite difficult. 

This problem has now been solved satisfactorily by Fagnani 
and Zampieri [10]. Interestingly, their construction works 
equally well for nonabelian codes and, although it is based on 
the observer granule decomposition of the previous section, it 
does not make any use of duality. 

In this section we construct minimal syndrome-formers and 
observer-form encoders for Examples 2-4 of this paper, and 
also for the main example of [10]. Our approach uses the 
observability granules of C directly, and seems simpler than 
the general methods of [10] for these simple codes. 

A minimal syndrome-former for C is a dynamical map 
from yv to the syndrome sequence space Yli^Sk{C) that has 
at least the following properties: 

(a) The kernel of the map is the code C; 

(b) If C is L-observable, then the map has memory L; 

(c) The time-fc state space corresponds in some way to the 
active observer granules at time k. 

We also desire that the inverse images of the syndrome 
sequences form a disjoint partition of W in which each inverse 
image is in some sense isomorphic to C (see [10]). However, 
we ignore here the behavior of the syndrome-former for input 
sequences not in C. Nevertheless, in all our examples, our 
syndrome-former construction turns out to have this property. 

An encoder for C is a dynamical one-to-one map from the 
memoryless input sequence space Hfe -Pfe(C) to C. A minimal 
observer-form encoder for C is an encoder for C whose 



state space at time k corresponds in some sense to the active 
observer granules at time k. 

Our constructions will be based on the construction of a 
minimal state observer for C If C is L-observable, then a 
state observer for C with memory L is a system that maps 
c\[k-L,k) G C\[k-L,k) to the State tTfc(c) of c e C at time k for 
each time k. In other words, the state observer dynamically 
implements the state map cr : C — > <t(C) using a "shding 
window" of width L. 

In view of the dual state granule theorem, the state 
(Tfe(c) is determined by the values of the observer granules 
^[i-j.i] {C),k < i < k + j,l < j < L; namely, the observer 
granules that are "active" at time k. A state observer is minimal 
if its state space at time k corresponds in some sense to the 
active observer granules at time k. 

Our approach to realizing such a minimal state observer 
is as follows. If c G C, then a fortiori c G for all j- 
observable supercodes ,0 < j < L. Given c e C^~^, the 
jth-level observer granule $[,,_j ,,](C) may be computed by 
determining the character table column ("check") 

(r[,_,-,](c^),c) = {(x,c) I X e r[,_,-,](c^)} 

since Fj^.j (C""-) acts as the character group of $[i_j^j](C). 
This requires the calculation of the pairing (x, c) only for a 
set of generators of r[j_j (C^). 

Since the pairing (x, c) is a componentwise sum over 
the interval [i — j, i], and since the character table column 
(r[j_j j] (C^), c) specifies an element of $[j_j j](C), imple- 
mentation of such a pairing requires only a memory element 
storing an element of $[i_j i](C) that is active during the 
interval {i—j, i]. At each time during this interval, the memory 
element stores a "partial sum" in $[j_j^j](C). The values of 
all of the partial sums corresponding to all active observer 
granules is then the observer state at time k. 

Given a minimal state observer for C, a minimal observer- 
form encoder for C may then be reaUzed as follows. Assume 
that at time k the encoder has generated the past 0^.- of a 
code sequence c e C. A minimal state observer that tracks this 
past will indicate the current state ak (c) by the stored values 
of its currently active observer granules. The next output is 
then determined by an "input" in the first-output group Fk (C) 
and the current state crfc(c). 

Specifically, the next output G Gk must be chosen so 
that all observer granules ^[k-j,k]{C)j < j < L, that end 
at time k take on the value 0, since w e C if and only if the 
values of all quotients in the chain 

C=C^ C c^-^ C • • • C C° C W 

are equal to zero. In view of the dual first-output chain 

Fk{C) = F^''=(C) C i^^-i''=(C) C . . . C F^'^^CC) = C^k}, 

given representatives of each quotient group 
i^j-i,fc(C)/i^j,fc(C) ^ $[fe_j-fc](C), this can be done by 
subtracting representatives from an arbitrary "free" input in 
C|{j.i, according to the current partial sums of the ending 
granules $[fc_j /5](C), leaving a residual free input in Ffe(C). 
This produces a next output Ck such that c^(^k+i)- £ 
which determines the next state, and so forth. 
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Cfe-1 




(a) (b) 
Figure 8.1. Minimal (a) observer-form encoder and 
(b) syndrome-former for bi-infinite repetition code C. 



Similarly, a minimal syndrome-former can simply check 
whether the next output is in the appropriate set determined by 
(Tfc(c). If so, it continues. If not, then it needs to make some 
"correction" to reduce it to this set, so that the state observer 
can continue. 

We now give some applications of this approach. 
Example 2 (cont.) For the bi-infinite repetition code C over 
G, the state space at any time k is G, and consists of a single 
first-level observer granule ^[i.-i,k]{C) — G. The first-output 
(input) group of C is trivial, Fk{C) = {0}, and the syndrome 
group Sk{C) is G. 

The check corresponding to ^[k-i,k]{C) is orthogonality 
to the dual first-level controller granule r[fc_ijt] (C^) = 
{(.. .,0,/i, -/i,0,.. .) I h e G"}. For w e G^, we have 

((..., 0, h, -h, 0, . . .), w) - {{h, wk-i -wk)\he Gl, 

which is equal to zero for all ft, € G" if and only if Wk = Wk-i- 
A minimal state observer for C therefore needs only to store 
the partial sum Wk-i £ G at time k, so it has memory 1. 

A minimal observer-form encoder for C stores the previous 
output Ck-i S G and enforces the constraint Ck = Ck-i, as 
shown in Figure 8.1(a); i.e., there is no nontrivial input, and the 
state space is G. The initial condition of the memory element 
is unspecified, and its effect persists indefinitely. 

A minimal syndrome-former for C may simply be con- 
structed by implementing this check dynamically, as shown 
in Figure 8.1(b). (Conversely, the minimal encoder of Figure 
8.1(a) may be obtained by forcing Sfe = in Figure 8.1(b).) 
The value of each check is the syndrome Sk = Wk—Wk-i & G. 
The syndrome sequence is if and only if w G C, and in this 
case the syndrome-former acts as a state observer for C. In 
this example each coset C + s of C in W maps to a unique 
syndrome sequence s e G^. □ 
Example 3 (cont.) We now consider our 1-observable rate- 1/3 
convolutional code C over Z4. 

For an element g e Z4, it will often be useful to consider a 
two-bit representation {gi , go) G (^2)^ such that g = 2gi +.go; 
i.e., gi is the "high-order bit" and go is the "low-order bit." 

We recall that C has nontrivial observer granules at levels 
and 1 isomorphic to Z2 and Z4 x Z2, respectively. The 
zeroth-level observer granule corresponds to the constraint 
that Ck,3 G 2Z4 — i.e., the low-order bit co,k,3 equals 0. 
Thus C|{o} = Z4 X Z4 X 2Z4. The first-level granule cor- 
responds to the constraint of orthogonality with the shifts of 
the generators hi = (. . . , 000, ICQ, 030, 000, . . .) and h2 = 
(. . . , 000, 020, 001, 000, . . .) of C-L. The inner product with 
hi yields the constraint Ck-i ■ (100) + Ck • (030) = 0, or 
Cfe,2 = Cfe_i,i. The inner product with h2 yields Ck-i ■ (020) -|- 
Cfe ■ (001) = 0, or ci,fe,3 = co,fe-i,2. 



In short, Co,fe,3 = 0, Ci,fe,3 = Co,fe-i,2, and Ck,2 = Cfc-1,1. 
Thus we obtain a minimal observer-form encoder with "free 
input" Cfc^i G Z4, as shown in Figure 8.2(a). Note that this 
encoder is feedbackfree, and is also a minimal controller-form 
encoder with controller memory 2. 

Similarly, a minimal syndrome-former for C has two levels. 
The zeroth (nondynamical) level checks whether Wk.3 G 2Z4, 
or equivalently whether Wo,fe,3 = 0, and, if not, "corrects" to 
meet this constraint. This can be done simply by regarding 
uio,fc,3 as the zeroth-level syndrome, and ignoring it thereafter. 
The next (first) level checks the constraints Ck,2 = Cfc_i,i and 
ci,fe,3 = Co,fc-i,2 by forming the syndromes Sk,2 = Wk,2 - 
uJk-1,1 G Z4 and.si^fe^3 = ?i;i,fe,3 -'"'o,fe-i,2 e ^2, as shown in 
Figure 8.2(b). For simplicity, we merely compare the two bits 
of Wk,2 and Wk-iy, this makes the syndrome-former linear 
over Z2. 

The syndrome-former is evidently feedbackfree and has 
memory 1. Its output sequence s is if and only if w G C, 
and in this case the syndrome-former acts as a state observer 
for C. 

For the dual 2-observable rate-2/3 code C^, recall that 
has nontrivial observer granules at levels 1 and 2 isomorphic 
to Z2 and Z2, respectively. The first-level observer granules 
correspond to the constraint of orthogonality with the shifts of 
2g = (. . . , 000, 200, 020, 000, . . .), which yields the constraint 
2cfc,2 = 2cfc_i,i, or co,fe,2 = co,fc-i,i. The second-level ob- 
server granules correspond to orthogonality with the shifts of 
g = (. . . , 000, 100, 010, 002, 000, . . .), which yields 2cfe,3 = 
Cfe-1,2 + Cfc_2,i. If co,fc-i,2 = co,fe-2,i, which is guaranteed 
by the first-level constraint, then this is equivalent to co,fc,3 = 
ci,fe-i,2 + ci,fe-2,i + co,fe-2,i, where co,fe-2,i is a "carry bit." 

Thus we obtain a minimal observer-form encoder with 
"free" binary inputs ci,fe,i, co,fe,i, ci,fe,2, ci,fe,3, shown in Fig- 
ure 8.3(a). The encoder is feedbackfree with memory 2, and 
is Z2-hnear. 

A minimal syndrome-former for C-^ again has two levels. 

The first level checks whether wo,/c,2 = W[),k-i,i by forming 
the syndrome so,/c,2 = wo,k,2 + WQ^k-1,1 € ^2- The second 
level checks whether wo,fc,3 = wi,k-i,2+wi,k-2,i by forming 
the syndrome wo,fc,3 = ^0,^,3 + wi,fc-i,2 + wi,fe-2,i + 
wo,k-2,i = ■u;o,/c,3 +io,/c-i,3 € ^2, as shown in Figure 8.3(b). 
The syndrome-former is feedbackfree with memory 2, and is 
Z2-linear. □ 

Example 4 (cont.) For Loeliger's code C, the state space at any 
time k is R/Z, and it consists of a single first-level observer 
granule $[fc-i.fe](C) = M/Z. The first-output (input) group 
of C is binary, Ffe(G) = {0. \} = (iZ)/Z, and the syndrome 
group SkiC) is (R/Z)/i^fc(C) ^ M/Z. A set of representatives 
for (]R/Z)/Ffc(C) is the interval [0, 1/2). 

The check corresponding to $[fe-i,/c](C) is orthogonaUty 
to the dual first-level controller granule Y[k-i,k]{C'^)^ which 
is generated by h = (...,0,1,-2,0,...). For w G W = 
(R/Z)^, we have 

(h,w) = Wk-i - 2wk G M/Z. 

A minimal state observer for C therefore needs only to store 
the partial sum Wk-i G R/Z of this check at time k, and thus 
has memory 1. 
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Figure 8.2 Minimal (a) observer-form encoder and (b) syndrome-former for rate-1/3 convolutional code over Z4. 
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Figure 8.3 Minimal (a) observer-form encoder and (b) syndrome-former for rate- 2/3 convolutional code over Z4. 



A minimal observer-form encoder for C stores the previous 
output Cfe-i G M/Z and enforces the constraint 2cfe = 
Cfc_i mod Z. The set of Ck € M/Z that satisfy this constraint 
is the set Ck = {uk + \ Uk G {0, i}}, so the encoder 

has a binary input Uk & Fk{C) and a state space of M/Z, as 
shown in Figure 8.4(a). The initial condition of the memory 
element decays to zero (but is still visible forever in Cfe). 

A minimal syndrome-former for C may be constructed by 
implementing this check dynamically, as shown in Figure 
8.4(b). (Conversely, the minimal encoder of Figure 8.4(a) may 
be obtained by forcing = in Figure 8.4(b). Note that 
there are two values of Wk that satisfy 2wk = Wk-i mod Z, 
namely u)k = {uk + \wk-i \ Uk G {0, \}}.) The value of 
each check is the syndrome Sk = 2wk — Wk-i G M/Z. The 
syndrome sequence is if and only if w G C, and in this case 
the syndrome-former acts as a state observer for C. In this 
example also each coset C + s of C in >V maps to a unique 
syndrome sequence s G (M/Z)^. 

Finally, consider the chaotic time-reversed code C. The state 
space at any time k is M/Z, and consists of a single first- 
level observer granule ^[k-\,k]{C) — I^/^- The first-output 
(input) group of C is trivial, Fk{C) = Lk{C) = {0}, and 
the syndrome group Sk{C) is M/Z. A minimal observer-form 
encoder for C stores the previous output Ck-i G M/Z and 
enforces the constraint Ck = 2cfe-i mod Z, which completely 
determines Ck, as shown in Figure 8.4(c); i.e., there is no 
nontrivial input, and the state space is M/Z. Since the map 
Ck-i — > 2cfe_i mod Z is "expansive," the behavior of C is 
not only uncontrollable, but in fact chaotic. □ 

Example 7. This code was the main example in [10]. It turns 
out that our construction method yields a simpler syndrome- 
former than the general construction given in [10]. 

Let C be the set of sequences in (Z4)^ that (a) are either all 
odd or all even, and (b) have period 1 or 2. In other words, a 
code sequence is the bi-infinite repetition of one of the 8 pairs 



{00,22,02,20,11,33,13,31}; therefore C ^ Z4 x Z2. The 
dual is the finite linear code C"*- over Z4 generated by shifts 
of hi = (...,0,2,2,0,...) and hs = (...,0,1,0,1,0,...). 

C is clearly linear, time-invariant, autonomous and 2- 
observable. Its first-level observer granules ^[k-i,k]{C) check 
orthogonality to hi (2cfc = 2ck-i) and are isomorphic 
to Z2; its second-level observer granules <I'[fe-2,fe] (C) check 
orthogonality to h2 (ck = Ck-2) and are isomorphic to Z2 
(assuming c G C^). Its first-output (input) group is {0}, and 
its syndrome group is Z4. 

A minimal observer-form encoder for C may store the previ- 
ous output Ck-i G Z4 in the two-bit form (co,fc_i, ci^fe_i). At 
the first level, it enforces the constraint 2ck = 2ck-i, which 
determines the low-order bit Co,fe of c^. Given this constraint, 
it need only store the high-order bit ci,fe_i to enforce the 
second-level constraint ci_fc = ci_fc_2, which determines ci fc. 

A minimal memory-2 syndrome-former for C may store 
the low-order bit Wkfi for one time unit and the high-order 
bit Wk.i for two time units, so as to compute the first-level 
syndrome so.fe = wo,fe— uio,fe-i and the second-level syndrome 
s\,k = wi^k — 'w-i^k-2, as shown in Figure 8.5(b). The 
syndrome-former is feedbackfree with memory 2, and is Z2- 
linear. Again, the encoder may be derived from the syndrome- 
former simply by forcing the syndromes to 0. □ 

IX. The end-around theorem 

In this section we show that every observer granule of a 
group code C may be viewed purely algebraically as an "end- 
around" controller granule, and vice versa. As consequences 
of this observation, we develop: 

• A definition of observer granules for nonabelian group 
codes; 

• Simple, purely algebraic alternative proofs of some pre- 
vious results; 

• Myriad further isomorphisms. 
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Figure 8.4. Minimal (a) observer-form encoder and (b) syndrome-former for Loeliger's code C, and 
(c) minimal observer-form encoder for the chaotic time-reversed code C. 



Wo,k 







Co,fc 




co,fe-i 









Wo.k-1 



Wlk 



so.fe 















Cl,fe-1 




Cl,fe-2 








Cl,fc 




(a) 







Wl,fe-1 



Wlh-2 



Sl,k 



(b) 

Figure 8.5 Minimal (a) observer-form encoder and (b) syndrome-former 
for the Fagnani-Zampieri periodic code over Z4 [10]. 



An interval T — [m, n),n > m, may be viewed as an "end- 
around" interval that "starts" at time n, wraps around from 
+00 to —00, and finally "ends" at time to — 1. We denote such 
an interval by [n, to). Similarly, we define [n, to] ~ T— (to, n) 
for n > m, an interval which "starts" at time n and "ends" 
at time to < n. If n = to + 1, then (to, n) is the empty set 
and T — (to, n) is the entire time axis T. Finally, we define 
(n, m] = I — {m,n],n > m, the end-around interval from 
time n + 1 to time m. 

We then define an end-around controller granule on 
[n,m],n > to, analogously to an ordinary controller granule, 
as follows: 

C, 



r 



n,m] 



(C) 



^: [n,m] 



n > m. 



^:[n.m) ~t~ ^:(n,m] 

Then we obtain the following interesting isomorphism: 

Theorem 9.1 (end-around theorem): For n > m, the end- 
around controller granule r[„ „](C) is isomorphic to the 
observer granule „](C). 

Proof. The restrictions of C-[n^m] and C-[n,m) +C:{n,m] onto 
time n both have kernel C:(„.„i], with images {C:[n,m])\{n} = 
F"-'"-i^"(C) and ^„^))\{n} = F"-™'"(C), respectively, 
so by the correspondence theorem. 



[n.m 



](C)- 



F 



n—m.n 



(C) 



By Theorem 17. 101 this is isomorphic to „](C). □ 
We may similarly define an end-around observer granule 
^[n,m](C) for n > TO, and show that it is isomorphic to 

One consequence of the end-around theorem is that all 
dynamical observer granules may be expressed as end-around 
controller granules. But controller granules, unlike observer 
granules, are well-defined for nonabelian group codes. There- 
fore it is possible to define the dynamical observer granules of 
a nonabehan code C by «'[„,„](C) = C.,[n,m]/iC:[„,m)C:(n.m]) 
(in multiplicative notation), which opens the door to extending 



our observer dynamics results to nonabelian codes. We regard 
this as an important topic for further study, especially in 
view of the successful constructions of [15] and [10] in the 
nonabelian case. 

We now sketch a few applications of the end-around theo- 
rem. These involve partitioning the time axis X into 2, 3, or 4 
subintervals, which we then regard as a new finite time axis 
T' of length 2, 3, or 4, respectively (as in Subsection VI-B). 

The state space theorem involves a two-way partition of X 
into disjoint subsets J' and X — J . We may regard a code 
C defined on Z as a code defined on the length-2 time axis 
X' — {J ^X~ J}, which we identify with the length-2 interval 
[1,2]. 

Now the nondynamical controller granules of C are 
r[i,i](C) = C:j and r[2_2](C) — C-i-j, and the sole dynam- 
ical controller granule is the first-level granule 2](C) = 
C/{C;j +C;i-j), which is the two-sided state space Tij[C). 
The nondynamical observer granules of C are $[1 i](C) = 
yV\j/C\j and $[2,2](C) = W|j_j/C|i_j, and the sole dy- 
namical observer granule is the first-level granule $[1.2] (C) — 
{C\j + C\x-j) /C, which we recognize as the two-sided recip- 
rocal state space S'^(C). The end-around controller granule 
r[2,i](C) is C/{C..j + C:i-j) = Sj(C). The end-around 
theorem therefore implies Yij{C) = I]'^(C), an important 
isomorphism that we derived previously as a corollary of the 
reciprocal state space theorem, as well as purely algebraically. 

The [to, n) -controllability and [m, n) -observability tests 
involve a three-way partition of X into disjoint subsets 
TO^ , [m, n), and n+. We may regard a code C defined on X as a 
code defined on the length-3 time axis X' — {ni^ , [to, n), 71+}, 
which we identify with the length-3 interval [1,3]. 

Now by the first [m, n)-observability test, C is [m,n)- 
observable if and only if C is 1-observable on X'; i.e., if and 
only if the second-level observer granule 4>[i 3](C) — C^/C^ 
is trivial, where = C and 

= {w e W I W|[i^2] e C|[i^2],W|[2,3] e C|[2,3]}. 
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By the end-around theorem, 

'i?[i,3](c) = r[3,i](c) 



C|i X C|2 X C|3 



c. 



[3,1] 



c,. 



:{3} 



C.„+ X C, 



SO C is [to, n)-observable if and only if C.[„ „j) = C.„+ x 
C-TO- • Thus the first [to, n)-observability test is equivalent to 
the second by the end-around theorem. 

Similarly, by our second [to, n) -controllability test, C is 
[to, n)-controllable if and only if C is 1 -controllable on I'; 
i.e., if and only if the second-level controller granule 



r[i,3](C) 



c 



'■.[1,2] +C:[2,3] 



is trivial. By the dual to the end-around theorem, Fji 3](C) is 
isomorphic to the end-around observer granule 



^[3,1] (C) 



C|{3} X C|{i} _ C| 

n+ X 



[3,1] 



^1 [n,m) 



SO C is [to, n) -controllable if and only if C\ 



C|„+ X 

C\m- ■ Thus the first [to, n)-controllability test is equivalent to 
the second by the dual end-around theorem. 

Projections of these quotients onto the subintervals 
TO~, [to, n), and n+ yield still further tests in terms of trivial 
quotients of primal and dual first-output and last-output chains, 
which are cumbersome to write but which have the advantage 
of being testable on a single interval. Even on a time axis of 
length 3, there are a great many isomorphisms that can be de- 
rived from the general granule isomorphisms, since the system 
dynamical structure is determined by only three dynamical 
controller granules ri2,r23 and ri23 and three dynamical 
observer granules $12,^23 and $123 (or equivalently three 
end-around controller granules r23i,r3i2 and r3i). 

A set of such isomorphisms is illustrated in Figure 9.1. 
Moreover, every permutation of the three indices {1,2,3} 
yields a similar set of further isomorphisms. Here C;\ x 
C:2 X C:3 is the 0-controllable subcode of C, and €-12 + C:23 
is the 1 -controllable subcode of C. The figure shows how 
C/{C:\ X C:2 X C:z) decomposes into the controllability granules 
ri2!r23 and ri23 = $31. similarly, C|i x C|2 x C|3 is the 
0-observable supercede of C, {C\i2 x C\^) n (C|i x C123) is 
the 1 -observable supercode of C, and the figure shows how 
(C|i X C|2 X C|3)/C decomposes into the observability granules 
$12, $23 and $123 = r3i. The diagram is self-dual. 

Finally, our jth dual first-output and last-output group 
results for j > 1 involve a four-way partition of 1 into disjoint 
subsets {k—j}, {k — j, k), {k}, (k,k — j), which we regard as 
a length-4 time iixis I' and identify with the length-4 interval 
[1,4]. 

In this point of view, the dual first-output group is 
the set of time-2 symbols in the subcode C;[3^4] that "starts" 
at time k and "ends" at time k — j — 1, 

F^'\C) = (C.[3,4])|{3}, 

while F^~^'''{C) is the set of time-2 symbols in the subcode 
C.[3^i] that "starts" at time k and "ends" at time k — j: 

-i,fc 



C\i X C|2; 



C:i X C 




C|12 XC|3 



El X Si 



S2 X S2 



C:12 X C..3 



■ 23 

-r23 ri2^ 

C:l X C..2 X C..3 

Figure 9.1. Granule isomorphisms on a length-3 time axis. 



Since the end-around controller granule r[3ij(C) is 
C:[3,i]/(C:[3_4] + C.[4 i]), we have by projection onto time 2 
and the end-around theorem 



-l,k 



F3'k(^C) 



r[3,i](C)^$[i,3](C), 



^.-i,/c(c) = (C.[3,1])k3}- 



where $[i 3](C) denotes the observer granule $[/j_j^fe](C). 
The isomorphism ]J-'^^^{C)/lJ'''{C) ^ ^^k,k+j]{C) may be 
derived similarly. 

X. Conclusion 
In this paper we have extended the duality principles that 
have proved to be so useful in coding and system theory to 
abelian group codes. We have introduced a bit of topology in 
order to make use of Pontryagin duality, but topology is not 
used in any essential way other than to clarify duahty princi- 
ples when the time axis is infinite. We have also introduced a 
few technical "well-behavedness" conditions, principally the 
closed-projections assumption. Since this assumption holds 
when symbol groups are compact, or a fortiori finite, we 
do not believe that it will prove to be restrictive in practical 
apphcations. 

We have generalized the dual state space theorem of Unear 
system theory, which shows in a precise sense that the state 
complexity of dual codes or systems is dual in the character 
group sense. We have also shown that there are well-defined 
dual notions of controllability and observability for codes and 
behaviors, rather than for state-space realizations of codes 
and behaviors as in classical and behavioral linear system 
theory. Finally, we have shown close connections between 
controllability and finite generatability, on the one hand, and 
observabiUty and finite checkability (completeness), on the 
other. 
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It is helpful to keep in mind both the controllability and 
observability properties of a code or system. An uncontrollable 
(resp. unobservable) system may have simple observabihty 
(resp. controllability) properties, as shown in Example 4. A 
"low-rate" code or system is usually more simply specified 
in controller form (e.g., by a generator matrix, encoder or 
image representation), whereas a "high-rate" code or system 
is usually more simply specified in observer form (e.g., by 
a parity-check matrix, syndrome-former or kernel represen- 
tation). Controller memory and observer memory are both 
important parameters of a system. 

It can also be helpful to characterize a code or system by 
its dual. For example, a complete compact code or system can 
be characterized by its finite discrete dual, whose properties 
are purely algebraic. Pathologies in the primal system will be 
reflected in pathologies in the dual system, but their nature 
will usually be quite different (e.g., in Examples 2 and 4). 

It appears to us that behavioral system theory and symbolic 
dynamics have focussed largely on observability structure. 
Systems are usually assumed to be complete and compact, and 
"memory" usually means observer memory (see, e.g., [19]). 
In automata theory, on the other hand, languages are usually 
sets of discrete and finitely supported sequences. We believe 
that each of these fields might benefit from a more balanced 
viewpoint. 

There are several clues in this work, as well as in [15] and 
[10], that the abehan assumption is inessential. It is not needed 
for the purely algebraic controllability structure discussed in 
[15], nor for the more difficult observer-form constructions of 
[10]. The key idea of [10] may be the recognition that even 
when a subgroup H (such as a code) is not normal in a group 
G (such as its output sequence space), the set G//H of left 
cosets of in G is nonetheless a tractable group-theoretic 
object upon which G acts naturally by translation. Moreover, 
in this paper we have shown that all observer granules are 
isomorphic to "end-around" controller granules, which remain 
well-defined in the nonabelian case. It may well be useful 
therefore to develop an alternative purely algebraic general 
theory of observabihty structure that will apply equally to 
abehan and nonabehan group codes. 
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